00000001:02000400:1.0F:1788665934.524107:0:2950:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1788665945.088955:0:3152:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1788665947.373377:0:3212:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 462 MB/s 00000001:01000000:2.0F:1788665947.624478:0:3212:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 410 MB/s 00000001:01000000:3.0:1788665947.882732:0:3212:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2767 MB/s 00000020:02000000:2.0:1788665948.688534:0:3244:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_3_gb7bcc87 00000400:02000000:3.0:1788665949.783010:0:3259:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.125@tcp [8/256/0/180] 00008000:02000000:0.0F:1788665954.705112:0:3409:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1788666010.206442:0:5213:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788666019.692451:0:5789:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:0.0:1788666019.692460:0:5789:0:(obd_mount.c:924:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788666019.692591:0:5789:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ba851faa 00000080:02000400:0.0:1788666019.692612:0:5789:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788666019.700890:0:5789:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788666019.700906:0:5789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788666019.701072:0:5789:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000021366573) 00000020:00000080:0.0:1788666019.701094:0:5789:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788666019.769637:0:5789:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788666019.777166:0:5789:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788666019.850458:0:5789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788666019.850495:0:5789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788666019.850513:0:5789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788666019.850558:0:5789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788666019.850708:0:5789:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788666019.851432:0:5789:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788666019.851442:0:5789:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788666019.851453:0:5789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96bbe788361e9683 00000020:01000004:2.0:1788666019.851461:0:5789:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788666019.851467:0:5789:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788666019.851471:0:5789:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ba851faa from MGS 00000020:01000004:2.0:1788666019.851477:0:5789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788666019.851512:0:5789:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000000db68395) 00000020:00000080:2.0:1788666019.851524:0:5789:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788666019.851719:0:5789:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ba851faa from MGS, refs=2 00080000:01000000:2.0:1788666019.851827:0:5789:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788666019.851835:0:5789:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96bbe788361e9691 00000100:00100000:2.0:1788666019.852043:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788666019.852342:0:5789:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788666019.852358:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788666019.853494:0:5789:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788666019.853503:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788666019.856516:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788666019.859095:0:5789:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788666019.859169:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788666019.861989:0:5789:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788666019.862001:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788666019.862921:0:5789:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788666019.862929:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788666019.864213:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666019.864219:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666019.864221:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666019.864540:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666019.864542:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666019.864544:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666019.865491:0:5789:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788666019.867404:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788666020.115057:0:5789:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2095 MB/s 00000001:01000000:2.0:1788666020.364795:0:5789:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3027 MB/s 00000001:01000000:3.0:1788666020.615715:0:5789:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 462 MB/s 00000001:01000000:3.0:1788666020.866013:0:5789:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 619 MB/s 00010000:00010000:3.0:1788666020.874967:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788666020.892144:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1788666020.919344:0:5789:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788666020.919373:0:5789:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788666020.919377:0:5789:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788666020.920607:0:5799:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788666020.920757:0:5789:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788666020.920806:0:5789:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788666020.921208:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788666020.921236:0:5789:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788666020.921752:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788666020.922200:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788666020.922212:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788666020.925394:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788666020.925408:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788666020.926081:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788666020.926088:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788666020.926656:0:5789:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788666020.926676:0:5789:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.125@tcp' 00000020:01000004:3.0:1788666020.926678:0:5789:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788666020.926743:0:5789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.125@tcp (typ=mgc) 00000020:00000080:3.0:1788666020.926762:0:5789:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.125@tcp (0000000059fa9918) 00000020:00000080:3.0:1788666020.926789:0:5789:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788666020.928106:0:5789:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d19feb9f@MGC192.168.201.125@tcp: add connection 192.168.201.125@tcp at head 00010000:00010000:3.0:1788666020.928280:0:5789:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.125@tcp-0 is initialized 00000040:01000000:3.0:1788666020.928287:0:5789:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788666020.928533:0:5803:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788666020.933564:0:5804:0:(mgc_request.c:629:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788666020.933647:0:5789:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.125@tcp (uuid 633727f4-1aad-4438-919b-34cfb144e459) 00000020:00000080:0.0:1788666020.933674:0:5789:0:(genops.c:1385:class_connect()) connect: client 633727f4-1aad-4438-919b-34cfb144e459, cookie 0x96bbe788361e969f 00000100:00080000:0.0:1788666020.933689:0:5789:0:(import.c:545:import_select_connection()) MGC192.168.201.125@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788666020.933696:0:5789:0:(import.c:665:import_select_connection()) MGC192.168.201.125@tcp: import 00000000d19feb9f using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1788666020.933754:0:5789:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000cf077327 x1875552186138752/t0(0) o250->MGC192.168.201.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788666020.933790:0:5789:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 633727f4-1aad-4438-919b-34cfb144e459->MGS 00000020:01000004:0.0:1788666020.933810:0:5789:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788666020.934180:0:5789:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788666020.934194:0:5789:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000cd082e1e) 00000020:00000080:0.0:1788666020.934205:0:5789:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788666020.937920:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000cf077327 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:633727f4-1aad-4438-919b-34cfb144e459:3274:1875552186138752:0@lo:250: 00000100:00100000:1.0:1788666020.938050:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666020.938154:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186138752 00000100:00100000:1.0:1788666020.938162:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186138752 00000100:00100000:1.0:1788666020.938203:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788666020.938209:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b36a715 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3274:x1875552186138752:12345-0@lo:250: 00010000:00080000:1.0:1788666020.938238:0:5800:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 633727f4-1aad-4438-919b-34cfb144e459@0@lo t0 exp 0000000000000000 cur 127 last 0 00000020:00000080:1.0:1788666020.938265:0:5800:0:(genops.c:1385:class_connect()) connect: client 633727f4-1aad-4438-919b-34cfb144e459, cookie 0x96bbe788361e96ad 00000100:00080000:1.0:1788666020.938413:0:5800:0:(import.c:65:import_set_state_nolock()) 00000000328d9125 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788666020.938480:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b36a715 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+5:3274:x1875552186138752:12345-0@lo:250: Request processed in 269us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666020.938487:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788666020.938530:0:3274:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.125@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788666020.938538:0:3274:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.201.125@tcp: connect to target with instance 0 00000100:00080000:1.0:1788666020.938546:0:3274:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.201.125@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788666020.938551:0:3274:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788666020.938555:0:3274:0:(import.c:65:import_set_state_nolock()) 00000000d19feb9f MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788666020.938564:0:3274:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788666020.938969:0:3274:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788666020.938976:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000cf077327 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:633727f4-1aad-4438-919b-34cfb144e459:3274:1875552186138752:0@lo:250: 00000100:00100000:0.0:1788666020.979225:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788666020.979424:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788666020.979430:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788666020.987196:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788666020.987211:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1788666020.988333:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1788666020.988343:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1788666020.990301:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788666020.990515:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1788666020.990522:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788666020.991444:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788666020.991451:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788666021.091071:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788666021.091282:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788666021.091289:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788666021.093604:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788666021.093626:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788666021.094561:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788666021.099801:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788666021.099812:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788666021.102194:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788666021.102209:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788666021.105188:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788666021.105426:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788666021.105432:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788666021.106388:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788666021.106397:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788666021.107459:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788666021.108282:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788666021.108289:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788666021.109855:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788666021.109865:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788666021.153293:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788666021.153519:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788666021.153525:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788666021.163749:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788666021.163766:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788666021.165530:0:5789:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788666021.165544:0:5789:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788666021.168332:0:5789:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788666021.168370:0:5789:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788666021.168376:0:5789:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.125@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788666021.168505:0:5789:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788666021.168540:0:5789:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.125@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788666021.168545:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788666021.168547:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788666021.168548:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788666021.168554:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788666021.168555:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788666021.168560:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788666021.168561:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788666021.168562:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788666021.168566:0:5789:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788666021.168567:0:5789:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788666021.168568:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788666021.168569:0:5789:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788666021.168571:0:5789:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788666021.168575:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788666021.168601:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788666021.168602:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788666021.168603:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788666021.168604:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788666021.168605:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788666021.168606:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788666021.168607:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788666021.168607:0:5789:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788666021.168608:0:5789:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788666021.168609:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788666021.168610:0:5789:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788666021.168654:0:5789:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788666021.168714:0:5789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000089ea548d pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186138880:0@lo:253: 00000100:00100000:2.0:1788666021.168900:0:5789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666021.168972:0:5789:0:(client.c:2716:ptlrpc_set_wait()) set 000000007de394a1 going to sleep for 11 seconds 00000100:00100000:3.0:1788666021.169052:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186138880 00000100:00100000:3.0:1788666021.169060:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186138880 00000100:00100000:3.0:1788666021.169139:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788666021.169148:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0d830e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+5:5789:x1875552186138880:12345-0@lo:253: 20000000:01000000:3.0:1788666021.169194:0:5802:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788666021.169197:0:5802:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788666021.169575:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788666021.169683:0:5802:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788666021.170032:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788666021.175687:0:5825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788666021.181306:0:5802:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788666021.181314:0:5802:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788666021.181321:0:5802:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788666021.181323:0:5802:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788666021.181338:0:5802:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788666021.181711:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788666021.182273:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788666021.182289:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788666021.182351:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788666021.182746:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788666021.183123:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788666021.183246:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788666021.183256:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788666021.183304:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788666021.183312:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788666021.183342:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788666021.183349:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788666021.183388:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788666021.183434:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788666021.183466:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788666021.183471:0:5802:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788666021.183483:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788666021.183710:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788666021.183720:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788666021.183754:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788666021.184070:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788666021.184142:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788666021.184154:0:5802:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788666021.184231:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788666021.184240:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788666021.184287:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788666021.184327:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788666021.184375:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788666021.184388:0:5802:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788666021.184504:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788666021.184513:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788666021.184547:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788666021.184768:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788666021.185207:0:5802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788666021.185254:0:5802:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788666021.185260:0:5802:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788666021.186102:0:5826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788666021.186418:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788666021.186442:0:5802:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.125@tcp for mdt 20000000:01000000:3.0:1788666021.186444:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.125@tcp (null) (null) (null) 00000040:00080000:3.0:1788666021.186481:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788666021.186489:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788666021.186520:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788666021.186528:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.125@tcp (null) (null) 00000040:00080000:3.0:1788666021.186572:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788666021.186755:0:5802:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788666021.186805:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788666021.186844:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788666021.186914:0:5802:0:(mgs_llog.c:5251:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788666021.186925:0:5802:0:(mgs_llog.c:4747:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788666021.186930:0:5802:0:(mgs_llog.c:5071:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788666021.186946:0:5802:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788666021.187480:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:3.0:1788666021.187714:0:5802:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1788666021.195539:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788666021.195821:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:3.0:1788666021.195915:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:3.0:1788666021.195945:0:5802:0:(mgs_llog.c:5251:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788666021.195948:0:5802:0:(mgs_llog.c:4747:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788666021.195951:0:5802:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788666021.195971:0:5802:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788666021.195974:0:5802:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788666021.196003:0:5802:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788666021.196006:0:5802:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788666021.196488:0:5828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788666021.196761:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788666021.196805:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788666021.196839:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1788666021.196853:0:5802:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788666021.196854:0:5802:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788666021.198189:0:5829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:3.0:1788666021.198438:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:3.0:1788666021.198476:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:3.0:1788666021.198548:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:3.0:1788666021.198563:0:5802:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788666021.198565:0:5802:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:3.0:1788666021.198572:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788666021.198631:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000727a603b/0x96bbe788361e96b4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666021.198648:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000727a603b/0x96bbe788361e96b4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666021.198657:0:5802:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000727a603b/0x96bbe788361e96b4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666021.198663:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000727a603b/0x96bbe788361e96b4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666021.198674:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000727a603b/0x96bbe788361e96b4 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666021.198681:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000727a603b/0x96bbe788361e96b4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666021.198686:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000727a603b already unused, calling callback (00000000b9e3307c) 00010000:00010000:3.0:1788666021.198689:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000727a603b/0x96bbe788361e96b4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666021.198696:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000727a603b/0x96bbe788361e96b4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666021.198708:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000727a603b/0x96bbe788361e96b4 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666021.198716:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000727a603b/0x96bbe788361e96b4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666021.198721:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000727a603b/0x96bbe788361e96b4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788666021.198735:0:5802:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788666021.503496:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0d830e6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+5:5789:x1875552186138880:12345-0@lo:253: Request processed in 334342us (334589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666021.503513:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788666021.503776:0:5789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000089ea548d pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186138880:0@lo:253: 10000000:01000000:2.0:1788666021.503791:0:5789:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788666021.503793:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788666021.503796:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788666021.503797:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788666021.503798:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788666021.503799:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788666021.503800:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788666021.503801:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788666021.503803:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788666021.503804:0:5789:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788666021.503805:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788666021.503806:0:5789:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788666021.503826:0:5789:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ba851faa from lustre-MDT0000 10000000:01000000:2.0:1788666021.503847:0:5789:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788666021.503849:0:5789:0:(mgc_request.c:327:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788666021.503853:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8ab2989a4d40 10000000:01000000:2.0:1788666021.503857:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788666021.503875:0:5789:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-sptlrpc-ffff8ab2989a4d40 from 1 10000000:01000000:2.0:1788666021.503879:0:5789:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788666021.503922:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 00000000c047e7da/0x96bbe788361e96bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666021.503941:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 00000000c047e7da/0x96bbe788361e96bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666021.503950:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 00000000c047e7da/0x96bbe788361e96bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666021.503965:0:5789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e734c9ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186139008:0@lo:101: 00000100:00100000:2.0:1788666021.504005:0:5789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666021.504058:0:5789:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003a0e3ca going to sleep for 11 seconds 00000100:00100000:3.0:1788666021.504175:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186139008 00000100:00100000:3.0:1788666021.504181:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186139008 00000100:00100000:3.0:1788666021.504215:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788666021.504222:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008aebbc23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+5:5789:x1875552186139008:12345-0@lo:101: 00010000:00010000:3.0:1788666021.504240:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666021.504251:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000727a603b/0x96bbe788361e96c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e96bb expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666021.504270:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000727a603b/0x96bbe788361e96c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e96bb expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666021.504279:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000727a603b/0x96bbe788361e96c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e96bb expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666021.504288:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000727a603b, rc 0) 00000100:00100000:3.0:1788666021.504329:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008aebbc23 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+6:5789:x1875552186139008:12345-0@lo:101: Request processed in 108us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666021.504336:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788666021.504743:0:5789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e734c9ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186139008:0@lo:101: 00010000:00010000:2.0:1788666021.504756:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 00000000c047e7da/0x96bbe788361e96bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e96c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666021.504764:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 00000000c047e7da/0x96bbe788361e96bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e96c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666021.504803:0:5789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e734c9ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186139136:0@lo:501: 00000100:00100000:2.0:1788666021.504826:0:5789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666021.504885:0:5789:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003a0e3ca going to sleep for 11 seconds 00000100:00100000:3.0:1788666021.506797:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186139136 00000100:00100000:3.0:1788666021.506809:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186139136 00000100:00100000:3.0:1788666021.506849:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788666021.506856:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3eb1fbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+6:5789:x1875552186139136:12345-0@lo:501: 00000100:00100000:3.0:1788666021.507197:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3eb1fbf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+6:5789:x1875552186139136:12345-0@lo:501: Request processed in 341us (2370us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788666021.507205:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788666021.507327:0:5789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e734c9ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186139136:0@lo:501: 10000000:01000000:2.0:1788666021.507385:0:5789:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788666021.507399:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 00000000c047e7da/0x96bbe788361e96bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e96c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666021.507411:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 00000000c047e7da/0x96bbe788361e96bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e96c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666021.507619:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab290a54800 10000000:01000000:2.0:1788666021.507623:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788666021.507628:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ab290a54800 10000000:01000000:2.0:1788666021.507630:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788666021.507634:0:5789:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-barrier-ffff8ab290a54800 from 1 10000000:01000000:2.0:1788666021.507636:0:5789:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788666021.507659:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 0000000014787e29/0x96bbe788361e96c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666021.507665:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 0000000014787e29/0x96bbe788361e96c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666021.507672:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 0000000014787e29/0x96bbe788361e96c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666021.507687:0:5789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e734c9ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186139264:0@lo:101: 00000100:00100000:2.0:1788666021.507776:0:5789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666021.508466:0:5789:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003a0e3ca going to sleep for 11 seconds 00000100:00100000:3.0:1788666021.510172:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186139264 00000100:00100000:3.0:1788666021.510185:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186139264 00000100:00100000:3.0:1788666021.510234:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788666021.510241:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e90b4665 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+6:5789:x1875552186139264:12345-0@lo:101: 00010000:00010000:3.0:1788666021.510258:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666021.510274:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007835c400/0x96bbe788361e96d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e96c9 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666021.510318:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007835c400/0x96bbe788361e96d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e96c9 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666021.510327:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007835c400/0x96bbe788361e96d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e96c9 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666021.510336:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007835c400, rc 0) 00000100:00100000:3.0:1788666021.510663:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e90b4665 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+7:5789:x1875552186139264:12345-0@lo:101: Request processed in 421us (2886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666021.510670:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788666021.510799:0:5789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e734c9ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186139264:0@lo:101: 00010000:00010000:2.0:1788666021.510814:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 0000000014787e29/0x96bbe788361e96c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e96d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666021.510822:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 0000000014787e29/0x96bbe788361e96c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e96d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666021.510838:0:5789:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788666021.510885:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 0000000014787e29/0x96bbe788361e96c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e96d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666021.510903:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 0000000014787e29/0x96bbe788361e96c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e96d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666021.510911:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788666021.510915:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788666021.510920:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ab290a54800 10000000:01000000:2.0:1788666021.510922:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788666021.510926:0:5789:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788666021.510928:0:5789:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788666021.510947:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 000000003af76f07/0x96bbe788361e96d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666021.510954:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 000000003af76f07/0x96bbe788361e96d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666021.510961:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 000000003af76f07/0x96bbe788361e96d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666021.510976:0:5789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e734c9ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186139392:0@lo:101: 00000100:00100000:2.0:1788666021.511005:0:5789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666021.511037:0:5789:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003a0e3ca going to sleep for 11 seconds 00000100:00100000:1.0:1788666021.511093:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186139392 00000100:00100000:1.0:1788666021.511097:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186139392 00000100:00100000:1.0:1788666021.511130:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788666021.511136:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d623fe58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+7:5789:x1875552186139392:12345-0@lo:101: 00010000:00010000:1.0:1788666021.511144:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666021.511152:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002625a32f/0x96bbe788361e96de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e96d7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666021.511175:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002625a32f/0x96bbe788361e96de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e96d7 expref: 8 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666021.511183:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002625a32f/0x96bbe788361e96de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e96d7 expref: 8 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666021.511189:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002625a32f, rc 0) 00000100:00100000:1.0:1788666021.511222:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d623fe58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+8:5789:x1875552186139392:12345-0@lo:101: Request processed in 86us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666021.511228:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788666021.511291:0:5789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e734c9ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186139392:0@lo:101: 00010000:00010000:2.0:1788666021.511300:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 000000003af76f07/0x96bbe788361e96d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e96de expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666021.511307:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 000000003af76f07/0x96bbe788361e96d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e96de expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666021.511366:0:5789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e734c9ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186139520:0@lo:501: 00000100:00100000:2.0:1788666021.511406:0:5789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666021.511426:0:5789:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003a0e3ca going to sleep for 11 seconds 00000100:00100000:3.0:1788666021.511474:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186139520 00000100:00100000:3.0:1788666021.511478:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186139520 00000100:00100000:3.0:1788666021.511508:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788666021.511514:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed90070d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+8:5789:x1875552186139520:12345-0@lo:501: 00000100:00100000:3.0:1788666021.511894:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed90070d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+9:5789:x1875552186139520:12345-0@lo:501: Request processed in 380us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666021.511901:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788666021.512186:0:5789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e734c9ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186139520:0@lo:501: 00000100:00100000:2.0:1788666021.512215:0:5789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e734c9ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186139648:0@lo:503: 00000100:00100000:2.0:1788666021.512250:0:5789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666021.512276:0:5789:0:(client.c:2716:ptlrpc_set_wait()) set 0000000003a0e3ca going to sleep for 11 seconds 00000100:00100000:3.0:1788666021.512525:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186139648 00000100:00100000:3.0:1788666021.512530:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186139648 00000100:00100000:3.0:1788666021.512558:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788666021.512572:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d617d0ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+9:5789:x1875552186139648:12345-0@lo:503: 00000100:00100000:2.0:1788666021.517672:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d617d0ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+9:5789:x1875552186139648:12345-0@lo:503: Request processed in 5094us (5415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666021.517718:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788666021.518027:0:5789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e734c9ba pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186139648:0@lo:503: 00000100:00100000:0.0:1788666021.518473:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000526741f pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:5831:1875552186139776:0@lo:502: 00000100:00100000:0.0:1788666021.518524:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666021.518572:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000887a40bf going to sleep for 11 seconds 00000100:00100000:2.0:1788666021.518900:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186139776 00000100:00100000:2.0:1788666021.518906:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186139776 00000100:00100000:2.0:1788666021.518946:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788666021.518952:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a020e911 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+9:5831:x1875552186139776:12345-0@lo:502: 00000100:00100000:2.0:1788666021.519157:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a020e911 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+9:5831:x1875552186139776:12345-0@lo:502: Request processed in 205us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666021.519164:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788666021.519269:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000526741f pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:5831:1875552186139776:0@lo:502: 00000020:01000000:0.0:1788666021.519290:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788666021.519300:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666021.519303:0:5831:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788666021.519307:0:5831:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788666021.519310:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788666021.519322:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000d79e558f) 00000020:00000080:0.0:1788666021.519338:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788666021.519342:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788666021.519427:0:5831:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788666021.519433:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96bbe788361e96ec 00000020:00000080:1.0:1788666021.520019:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788666021.520024:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788666021.520028:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666021.520029:0:5831:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788666021.520031:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788666021.520035:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666021.520036:0:5831:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788666021.520040:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788666021.520053:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000014372975) 00000020:00000080:1.0:1788666021.520065:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788666021.520069:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788666021.520071:0:5831:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788666021.520074:0:5831:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788666021.520079:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788666021.520128:0:5831:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ba851faa from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788666021.520141:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000ae9e27ca) 00000020:00000080:1.0:1788666021.520147:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788666021.520203:0:5831:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788666021.520209:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96bbe788361e9701 00000020:00000080:1.0:1788666021.520306:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788666021.520315:0:5831:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788666021.520319:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x96bbe788361e9708 00080000:01000000:1.0:1788666021.520323:0:5831:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788666021.520326:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96bbe788361e970f 00080000:10000000:1.0:1788666021.522208:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1788666021.522439:0:5831:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788666021.528071:0:5831:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788666021.623531:0:5831:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788666021.624020:0:5831:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788666021.625833:0:5831:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788666021.626045:0:5831:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788666021.652521:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000b1206cf0) 00000020:00000080:3.0:1788666021.652546:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788666021.652655:0:5831:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788666021.652661:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96bbe788361e971d 00000020:00000080:2.0:1788666021.653170:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788666021.654330:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788666021.715244:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788666021.768250:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788666021.796646:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788666021.869373:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00010000:00010000:3.0:1788666021.904104:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788666021.923188:0:5831:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1788666021.963936:0:5831:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x96bbe788361e9724 00000020:00000080:3.0:1788666021.964542:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788666021.964558:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666021.964565:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666021.964568:0:5831:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788666021.964571:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666021.964613:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666021.964615:0:5831:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788666021.964621:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788666021.964671:0:5831:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788666021.964686:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666021.964689:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666021.964881:0:5831:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788666021.964887:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666021.964891:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666021.964893:0:5831:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788666021.964896:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788666021.964898:0:5831:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788666021.964987:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa14834f pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:5831:1875552186139904:0@lo:502: 00000100:00100000:3.0:1788666021.965114:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666021.965236:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de4d61af going to sleep for 11 seconds 00000100:00100000:2.0:1788666021.965453:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186139904 00000100:00100000:2.0:1788666021.965464:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186139904 00000100:00100000:2.0:1788666021.965574:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788666021.965615:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c3d4762b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+9:5831:x1875552186139904:12345-0@lo:502: 00000100:00100000:2.0:1788666021.966232:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c3d4762b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+9:5831:x1875552186139904:12345-0@lo:502: Request processed in 618us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666021.966256:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788666021.966388:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa14834f pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:5831:1875552186139904:0@lo:502: 00000020:01000000:3.0:1788666021.966424:0:5831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666021.966430:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666021.966432:0:5831:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788666021.966436:0:5831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788666021.966732:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788666021.966762:0:5789:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788666021.966787:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 000000003af76f07/0x96bbe788361e96d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e96de expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666021.966800:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 000000003af76f07/0x96bbe788361e96d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e96de expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666021.966810:0:5789:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff8ab290a54800 from 1 10000000:01000000:0.0:1788666021.966822:0:5789:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788666021.966870:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 00000000ceec2262/0x96bbe788361e972b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666021.966878:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 00000000ceec2262/0x96bbe788361e972b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666021.966903:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 00000000ceec2262/0x96bbe788361e972b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666021.966927:0:5789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000526741f pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186140032:0@lo:101: 00000100:00100000:0.0:1788666021.966982:0:5789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666021.967325:0:5789:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c2fd43f going to sleep for 11 seconds 00000100:00100000:1.0:1788666021.967414:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186140032 00000100:00100000:1.0:1788666021.967422:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186140032 00000100:00100000:1.0:1788666021.967461:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788666021.967469:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2349763 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+9:5789:x1875552186140032:12345-0@lo:101: 00010000:00010000:1.0:1788666021.967485:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666021.967502:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000019589fe1/0x96bbe788361e9732 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e972b expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666021.967533:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000019589fe1/0x96bbe788361e9732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e972b expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666021.967546:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000019589fe1/0x96bbe788361e9732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e972b expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666021.967557:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000019589fe1, rc 0) 00000100:00100000:1.0:1788666021.967627:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2349763 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+10:5789:x1875552186140032:12345-0@lo:101: Request processed in 159us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666021.967633:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788666021.967734:0:5789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000526741f pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186140032:0@lo:101: 00010000:00010000:0.0:1788666021.967750:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 00000000ceec2262/0x96bbe788361e972b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9732 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666021.967760:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 00000000ceec2262/0x96bbe788361e972b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9732 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666021.968340:0:5789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000526741f pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186140160:0@lo:256: 00000100:00100000:0.0:1788666021.968409:0:5789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666021.968448:0:5789:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c2fd43f going to sleep for 11 seconds 00000100:00100000:1.0:1788666021.968605:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186140160 00000100:00100000:1.0:1788666021.968620:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186140160 00000100:00100000:1.0:1788666021.968650:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788666021.968657:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b3bb3eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+10:5789:x1875552186140160:12345-0@lo:256: 20000000:01000000:1.0:1788666021.968677:0:5800:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788666021.968684:0:5800:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788666021.968779:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b3bb3eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+10:5789:x1875552186140160:12345-0@lo:256: Request processed in 123us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666021.968786:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788666021.968909:0:5789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000526741f pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186140160:0@lo:256: 10000000:01000000:0.0:1788666021.969527:0:5789:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788666021.969559:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 00000000ceec2262/0x96bbe788361e972b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9732 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666021.969572:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 00000000ceec2262/0x96bbe788361e972b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9732 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666021.969623:0:5789:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff8ab290a54800 from 1 10000000:01000000:0.0:1788666021.969627:0:5789:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788666021.969674:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 00000000990e788d/0x96bbe788361e9739 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666021.969683:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 00000000990e788d/0x96bbe788361e9739 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666021.969955:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 00000000990e788d/0x96bbe788361e9739 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666021.969981:0:5789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000526741f pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186140288:0@lo:101: 00000100:00100000:0.0:1788666021.970042:0:5789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666021.970124:0:5789:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c2fd43f going to sleep for 11 seconds 00000100:00100000:3.0:1788666021.970271:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186140288 00000100:00100000:3.0:1788666021.970286:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186140288 00000100:00100000:2.0:1788666021.970399:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788666021.970410:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da41afcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+10:5789:x1875552186140288:12345-0@lo:101: 00010000:00010000:2.0:1788666021.970426:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666021.970444:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ef6aadb8/0x96bbe788361e9740 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e9739 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666021.970470:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ef6aadb8/0x96bbe788361e9740 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e9739 expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666021.970481:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ef6aadb8/0x96bbe788361e9740 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9739 expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666021.970490:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ef6aadb8, rc 0) 00000100:00100000:2.0:1788666021.970602:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da41afcb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+11:5789:x1875552186140288:12345-0@lo:101: Request processed in 195us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666021.970609:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788666021.971113:0:5789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000526741f pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186140288:0@lo:101: 00010000:00010000:0.0:1788666021.971133:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 00000000990e788d/0x96bbe788361e9739 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9740 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666021.971143:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 00000000990e788d/0x96bbe788361e9739 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9740 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666021.971213:0:5789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000526741f pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186140416:0@lo:501: 00000100:00100000:0.0:1788666021.971248:0:5789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666021.971407:0:5789:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c2fd43f going to sleep for 11 seconds 00000100:00100000:2.0:1788666021.971494:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186140416 00000100:00100000:2.0:1788666021.971501:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186140416 00000100:00100000:2.0:1788666021.971531:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788666021.971538:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f9eedae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+11:5789:x1875552186140416:12345-0@lo:501: 00000100:00100000:2.0:1788666021.972267:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f9eedae6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+11:5789:x1875552186140416:12345-0@lo:501: Request processed in 728us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666021.972275:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788666021.972492:0:5789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000526741f pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186140416:0@lo:501: 00000100:00100000:0.0:1788666021.972543:0:5789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000526741f pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186140544:0@lo:503: 00000100:00100000:0.0:1788666021.972636:0:5789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666021.972668:0:5789:0:(client.c:2716:ptlrpc_set_wait()) set 000000001c2fd43f going to sleep for 11 seconds 00000100:00100000:2.0:1788666021.973011:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186140544 00000100:00100000:2.0:1788666021.973019:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186140544 00000100:00100000:2.0:1788666021.973051:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788666021.973058:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000198ca9b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+11:5789:x1875552186140544:12345-0@lo:503: 00000040:00080000:2.0:1788666021.973121:0:5802:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788666021.973225:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000198ca9b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+11:5789:x1875552186140544:12345-0@lo:503: Request processed in 167us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666021.973233:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788666021.973302:0:5789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000526741f pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186140544:0@lo:503: 00000040:00080000:2.0:1788666021.974226:0:5835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788666021.974470:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788666021.974503:0:5789:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788666021.974564:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 00000000990e788d/0x96bbe788361e9739 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9740 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666021.974576:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 00000000990e788d/0x96bbe788361e9739 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9740 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666021.974648:0:5789:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788666021.974651:0:5789:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff8ab290a54800 10000000:01000000:0.0:1788666021.974653:0:5789:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab290a54800 10000000:01000000:0.0:1788666021.974657:0:5789:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788666021.974662:0:5789:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff8ab290a54800 from 1 10000000:01000000:0.0:1788666021.974664:0:5789:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788666021.974707:0:5789:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 00000000bf711f92/0x96bbe788361e9747 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666021.974713:0:5789:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 00000000bf711f92/0x96bbe788361e9747 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666021.974721:0:5789:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 00000000bf711f92/0x96bbe788361e9747 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666021.974742:0:5789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000526741f pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186140672:0@lo:101: 00000100:00100000:0.0:1788666021.974796:0:5789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666021.974831:0:5789:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cb4c314c going to sleep for 11 seconds 00000100:00100000:2.0:1788666021.974906:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186140672 00000100:00100000:2.0:1788666021.974914:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186140672 00000100:00100000:2.0:1788666021.974954:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788666021.974963:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000600d55cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+11:5789:x1875552186140672:12345-0@lo:101: 00010000:00010000:2.0:1788666021.974977:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666021.974992:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b19e7a2f/0x96bbe788361e974e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e9747 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666021.975015:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b19e7a2f/0x96bbe788361e974e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e9747 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666021.975024:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b19e7a2f/0x96bbe788361e974e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9747 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666021.975031:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b19e7a2f, rc 0) 00000100:00100000:2.0:1788666021.975068:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000600d55cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+12:5789:x1875552186140672:12345-0@lo:101: Request processed in 108us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666021.975074:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788666021.975198:0:5789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000526741f pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186140672:0@lo:101: 00010000:00010000:0.0:1788666021.975210:0:5789:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 00000000bf711f92/0x96bbe788361e9747 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e974e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666021.975216:0:5789:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 00000000bf711f92/0x96bbe788361e9747 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e974e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666021.975261:0:5789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000526741f pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186140800:0@lo:501: 00000100:00100000:0.0:1788666021.975280:0:5789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666021.975300:0:5789:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cb4c314c going to sleep for 11 seconds 00000100:00100000:1.0:1788666021.975312:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186140800 00000100:00100000:1.0:1788666021.975317:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186140800 00000100:00100000:1.0:1788666021.975366:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788666021.975373:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004804a0df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+12:5789:x1875552186140800:12345-0@lo:501: 00000100:00100000:0.0:1788666021.975793:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004804a0df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+12:5789:x1875552186140800:12345-0@lo:501: Request processed in 419us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666021.975809:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788666021.976126:0:5789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000526741f pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186140800:0@lo:501: 00000100:00100000:1.0:1788666021.976163:0:5789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e29c3d2b pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186140928:0@lo:503: 00000100:00100000:1.0:1788666021.976203:0:5789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666021.976229:0:5789:0:(client.c:2716:ptlrpc_set_wait()) set 000000005b1ad4ea going to sleep for 11 seconds 00000100:00100000:2.0:1788666021.976240:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186140928 00000100:00100000:2.0:1788666021.976246:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186140928 00000100:00100000:2.0:1788666021.976278:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788666021.976286:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009334e87e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+12:5789:x1875552186140928:12345-0@lo:503: 00000100:00100000:2.0:1788666021.976656:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009334e87e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+12:5789:x1875552186140928:12345-0@lo:503: Request processed in 370us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666021.976670:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788666021.976787:0:5789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e29c3d2b pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186140928:0@lo:503: 00000100:00100000:1.0:1788666021.977210:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e29c3d2b pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:5836:1875552186141056:0@lo:502: 00000100:00100000:1.0:1788666021.977244:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666021.977268:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053248fdc going to sleep for 11 seconds 00000100:00100000:0.0:1788666021.977283:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186141056 00000100:00100000:0.0:1788666021.977289:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186141056 00000100:00100000:0.0:1788666021.977318:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788666021.977325:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001e9bdf84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+12:5836:x1875552186141056:12345-0@lo:502: 00000100:00100000:0.0:1788666021.977536:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001e9bdf84 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+12:5836:x1875552186141056:12345-0@lo:502: Request processed in 211us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666021.977544:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788666021.977562:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e29c3d2b pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:5836:1875552186141056:0@lo:502: 00000020:01000004:2.0:1788666021.977807:0:5836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788666021.977829:0:5836:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000120b13a9) 00000020:00000080:2.0:1788666021.977856:0:5836:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788666021.977949:0:5836:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ba851faa from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788666021.977954:0:5836:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ba851faa from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788666021.977956:0:5836:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ba851faa 4 00010000:00080000:2.0:1788666021.977987:0:5836:0:(ldlm_lib.c:102:import_set_conn()) imp 000000007c51437a@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.125@tcp at head 00010000:00010000:2.0:1788666021.979844:0:5836:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788666021.980102:0:5836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788666021.980148:0:5836:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788666021.980163:0:5836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x96bbe788361e975c 00000100:00080000:2.0:1788666021.980176:0:5836:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788666021.980182:0:5836:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000007c51437a using connection 192.168.201.125@tcp/0@lo 00000100:00100000:2.0:1788666021.980228:0:5836:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a5efaf7c x1875552186141184/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788666021.980254:0:5836:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788666021.980291:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a5efaf7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875552186141184:0@lo:38: 00000100:00100000:1.0:1788666021.980402:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666021.981987:0:5836:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000797526ca pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:5836:1875552186141312:0@lo:502: 00000100:00100000:1.0:1788666021.982076:0:5836:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666021.982116:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186141312 00000100:00100000:1.0:1788666021.982124:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186141312 00000100:00100000:1.0:1788666021.982167:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788666021.982173:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023c2a0fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+12:5836:x1875552186141312:12345-0@lo:502: 00000100:00100000:1.0:1788666021.982423:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023c2a0fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+12:5836:x1875552186141312:12345-0@lo:502: Request processed in 248us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666021.982431:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788666021.982497:0:5836:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053248fdc going to sleep for 11 seconds 00000100:00100000:1.0:1788666021.982527:0:5836:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000797526ca pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:5836:1875552186141312:0@lo:502: 00000040:00080000:1.0:1788666021.982563:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1788666021.982674:0:5789:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788666021.982704:0:5789:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788666021.982722:0:5789:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 00000000bf711f92/0x96bbe788361e9747 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e974e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666021.982735:0:5789:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 00000000bf711f92/0x96bbe788361e9747 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e974e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788666021.982791:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788666021.982793:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788666021.982795:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666021.982796:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666021.982798:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666021.982800:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666021.982801:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788666021.982803:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788666021.982804:0:5789:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788666021.982805:0:5789:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788666021.982807:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666021.982809:0:5789:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788666021.982923:0:5789:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788666021.982928:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788666021.982929:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788666021.982931:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666021.982932:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666021.982933:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666021.982935:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666021.982936:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788666021.982937:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788666021.982938:0:5789:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788666021.982939:0:5789:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788666021.982940:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666021.982941:0:5789:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788666021.982959:0:5789:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788666021.982968:0:5789:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa14834f pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186141440:0@lo:253: 00000100:00100000:3.0:1788666021.983003:0:5789:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666021.983034:0:5789:0:(client.c:2716:ptlrpc_set_wait()) set 00000000de4d61af going to sleep for 11 seconds 00000100:00100000:2.0:1788666021.983044:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186141440 00000100:00100000:2.0:1788666021.983050:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186141440 00000100:00100000:2.0:1788666021.983116:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788666021.983124:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001904378c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+12:5789:x1875552186141440:12345-0@lo:253: 20000000:01000000:2.0:1788666021.983153:0:5800:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788666021.983174:0:5800:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788666021.984074:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186141184 00000100:00100000:0.0:1788666021.984084:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186141184 00000100:00100000:0.0:1788666021.984130:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788666021.984137:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e29c3d2b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3274:x1875552186141184:12345-0@lo:38: 00000100:00100000:0.0:1788666021.984231:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e29c3d2b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3274:x1875552186141184:12345-0@lo:38: Request processed in 93us (3828us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788666021.984239:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788666021.984287:0:3274:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788666021.984297:0:3274:0:(import.c:65:import_set_state_nolock()) 000000007c51437a lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788666021.984301:0:3274:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788666021.984304:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a5efaf7c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875552186141184:0@lo:38: 20000000:01000000:0.0:1788666022.027817:0:5800:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788666022.027843:0:5800:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788666022.029181:0:5824:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788666022.029191:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788666022.029221:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000087aa0520/0x96bbe788361e9763 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666022.029246:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000019589fe1/0x96bbe788361e9732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e972b expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666022.029255:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000087aa0520/0x96bbe788361e9763 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666022.029311:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000019589fe1/0x96bbe788361e9732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e972b expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666022.029330:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000019589fe1/0x96bbe788361e9732 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e972b expref: 12 pid: 5800 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666022.029362:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067ab6d11 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5824:1875552186141568:0@lo:104: 00000100:00100000:3.0:1788666022.029453:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666022.029528:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set 00000000da531141 going to sleep for 11 seconds 00000100:00100000:0.0:1788666022.029753:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186141568 00000100:00100000:0.0:1788666022.029765:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186141568 00000100:00100000:0.0:1788666022.029829:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788666022.029839:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a47d9f7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+3:5824:x1875552186141568:12345-0@lo:104: 00010000:00010000:0.0:1788666022.029857:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: 00000000ceec2262/0x96bbe788361e972b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9732 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666022.029925:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788666022.029931:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a47d9f7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+3:5824:x1875552186141568:12345-0@lo:104: Request processed in 94us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666022.029938:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788666022.030110:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666022.030117:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: 00000000ceec2262/0x96bbe788361e972b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9732 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666022.030126:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ceec2262 already unused, calling callback (0000000073a16527) 10000000:00010000:3.0:1788666022.030130:0:5797:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: 00000000ceec2262/0x96bbe788361e972b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e9732 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666022.030140:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: 00000000ceec2262/0x96bbe788361e972b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e9732 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788666022.030167:0:5797:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: 00000000ceec2262/0x96bbe788361e972b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e9732 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666022.030174:0:5797:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788666022.030221:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: 00000000ceec2262/0x96bbe788361e972b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9732 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666022.030229:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788666022.030262:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: 00000000ceec2262/0x96bbe788361e972b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9732 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666022.030269:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: 00000000ceec2262/0x96bbe788361e972b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9732 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666022.030292:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666022.030294:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666022.030295:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666022.030371:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788666022.030382:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009e39f530 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186141696:0@lo:103: 00000100:00100000:3.0:1788666022.030424:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666022.030482:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067ab6d11 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5824:1875552186141568:0@lo:104: 00010000:00010000:3.0:1788666022.030514:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000087aa0520/0x96bbe788361e9763 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666022.030823:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186141696 00000100:00100000:1.0:1788666022.030831:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186141696 00010000:00010000:1.0:1788666022.030857:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000019589fe1/0x96bbe788361e9732 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e972b expref: 13 pid: 5800 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666022.030889:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788666022.030897:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000022980b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:633727f4-1aad-4438-919b-34cfb144e459+13:3275:x1875552186141696:12345-0@lo:103: 00010000:00010000:1.0:1788666022.030912:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666022.030917:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000019589fe1/0x96bbe788361e9732 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e972b expref: 13 pid: 5800 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666022.030928:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000019589fe1/0x96bbe788361e9732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e972b expref: 13 pid: 5800 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666022.030944:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000019589fe1/0x96bbe788361e9732 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e972b expref: 13 pid: 5800 timeout: 278 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666022.030960:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000087aa0520/0x96bbe788361e9763 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666022.030982:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000087aa0520/0x96bbe788361e9763 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788666022.030999:0:5793:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001809728s 00010000:00010000:1.0:1788666022.031004:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000087aa0520/0x96bbe788361e9763 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666022.031011:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000087aa0520/0x96bbe788361e9763 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666022.031019:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000087aa0520/0x96bbe788361e9763 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666022.031025:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000087aa0520/0x96bbe788361e9763 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666022.031031:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000087aa0520 already unused, calling callback (00000000b9e3307c) 00010000:00010000:1.0:1788666022.031035:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000087aa0520/0x96bbe788361e9763 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666022.031042:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000087aa0520/0x96bbe788361e9763 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666022.031057:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000087aa0520/0x96bbe788361e9763 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666022.031067:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666022.031115:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000022980b9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:633727f4-1aad-4438-919b-34cfb144e459+12:3275:x1875552186141696:12345-0@lo:103: Request processed in 219us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666022.031122:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788666022.031161:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009e39f530 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186141696:0@lo:103: 00010000:00010000:1.0:1788666022.031181:0:5824:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000087aa0520/0x96bbe788361e9763 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666022.031189:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000087aa0520/0x96bbe788361e9763 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666022.031195:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000087aa0520/0x96bbe788361e9763 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666022.039046:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001904378c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+11:5789:x1875552186141440:12345-0@lo:253: Request processed in 55908us (56026us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666022.039072:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788666022.039229:0:5789:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa14834f pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:5789:1875552186141440:0@lo:253: 10000000:01000000:3.0:1788666022.039253:0:5789:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788666022.039258:0:5789:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788666022.039261:0:5789:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788666022.039286:0:5789:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666022.039288:0:5789:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666022.039289:0:5789:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666022.039290:0:5789:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666022.039292:0:5789:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788666022.039293:0:5789:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788666022.039295:0:5789:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788666022.039296:0:5789:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788666022.039298:0:5789:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666022.039300:0:5789:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788666022.039323:0:5789:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788666022.049482:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788666022.051265:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788666022.051557:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788666022.051960:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788666022.052210:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788666022.052414:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788666022.053502:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788666022.054064:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788666022.054263:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788666022.054475:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788666022.054998:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788666022.055199:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1788666022.099863:0:5789:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788666022.126325:0:5789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788666022.126329:0:5841:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1788666022.126335:0:5841:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788666022.126486:0:5842:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788666022.131610:0:5789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788666022.133089:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788666022.133495:0:5789:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788666022.133526:0:5789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788666022.134065:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788666022.135154:0:5789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788666022.135800:0:5789:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788666022.135838:0:5789:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788666022.136137:0:5789:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788666022.136375:0:5789:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1788666022.137891:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788666022.138070:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788666022.138222:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788666022.138376:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788666022.138523:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788666022.138808:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788666022.138973:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788666022.139129:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788666022.139280:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788666022.139452:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788666022.139641:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788666022.139876:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788666022.140026:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788666022.140201:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788666022.140373:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788666022.140539:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788666022.140980:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788666022.141136:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788666022.141283:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788666022.141461:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788666022.141633:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788666022.141879:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788666022.142067:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788666022.142223:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788666022.142377:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788666022.142522:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788666022.142686:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788666022.142987:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788666022.143126:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788666022.143297:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788666022.143462:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788666022.143657:0:5789:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788666022.143962:0:5789:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1788666022.162533:0:5842:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788666022.211918:0:5789:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788666022.211959:0:5789:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffacf701c37988 00100000:10000000:3.0:1788666022.211968:0:5789:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788666022.215224:0:5789:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788666022.215248:0:5789:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.125@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788666022.215266:0:5789:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=45 00000080:00000004:3.0:1788666022.215286:0:5789:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1788666022.298931:0:5842:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788666022.299490:0:5842:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788666022.299505:0:5842:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788666022.926339:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666023.948787:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666024.972933:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666026.000026:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788666026.072896:0:6085:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788666027.022037:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788666027.407980:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788666027.407992:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788666027.407995:0:8:0:(import.c:65:import_set_state_nolock()) 000000007c51437a lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788666027.408011:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000007c51437a using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1788666027.408035:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000004af93724 x1875552186141952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788666027.408076:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004af93724 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875552186141952:0@lo:38: 00000100:00100000:0.0:1788666027.410570:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666027.411928:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000123644a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186141824:0@lo:400: 00000100:00100000:2.0:1788666027.412004:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666027.412080:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186141824 00000100:00100000:2.0:1788666027.412089:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186141824 00000100:00100000:2.0:1788666027.412155:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788666027.412164:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c35aa8b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+11:3277:x1875552186141824:12345-0@lo:400: 00000100:00100000:2.0:1788666027.412218:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c35aa8b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+11:3277:x1875552186141824:12345-0@lo:400: Request processed in 55us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666027.412227:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788666027.412289:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000123644a7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186141824:0@lo:400: 00000100:00100000:3.0:1788666027.416531:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186141952 00000100:00100000:3.0:1788666027.416550:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186141952 00000100:00100000:3.0:1788666027.416640:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788666027.416647:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb4e9486 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3274:x1875552186141952:12345-0@lo:38: 00010000:00080000:3.0:1788666027.416681:0:5810:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 134 last 0 00000020:00000080:3.0:1788666027.416715:0:5810:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x96bbe788361e976a 00000004:00100000:3.0:1788666027.416811:0:5810:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788666027.418249:0:5810:0:(import.c:65:import_set_state_nolock()) 0000000074cd6010 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788666027.418384:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb4e9486 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875552186141952:12345-0@lo:38: Request processed in 1733us (7820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666027.418396:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788666027.419120:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004af93724 x1875552186141952/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788666037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788666027.419176:0:3274:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788666027.419184:0:3274:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788666027.419190:0:3274:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788666027.419192:0:3274:0:(import.c:65:import_set_state_nolock()) 000000007c51437a lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788666027.419199:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004af93724 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875552186141952:0@lo:38: 00010000:00010000:0.0:1788666028.042953:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666029.068639:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666030.092032:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788666030.999497:0:5804:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788666030.999507:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff8ab290a54800 from 3 10000000:01000000:0.0:1788666030.999513:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788666030.999570:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 000000000ec72d82/0x96bbe788361e9771 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666030.999609:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 000000000ec72d82/0x96bbe788361e9771 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666030.999621:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 000000000ec72d82/0x96bbe788361e9771 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666030.999645:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004af93724 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186142080:0@lo:101: 00000100:00100000:0.0:1788666030.999722:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666030.999778:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 0000000002be0451 going to sleep for 11 seconds 00000100:00100000:2.0:1788666030.999922:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186142080 00000100:00100000:2.0:1788666030.999931:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186142080 00000100:00100000:2.0:1788666030.999993:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788666031.000002:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7acda54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+11:5804:x1875552186142080:12345-0@lo:101: 00010000:00010000:2.0:1788666031.000015:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666031.000028:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000045c0e2a5/0x96bbe788361e9778 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e9771 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666031.000050:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000045c0e2a5/0x96bbe788361e9778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e9771 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666031.000061:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000045c0e2a5/0x96bbe788361e9778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9771 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666031.000071:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000045c0e2a5, rc 0) 00000100:00100000:2.0:1788666031.000121:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7acda54 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+12:5804:x1875552186142080:12345-0@lo:101: Request processed in 120us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666031.000141:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788666031.002365:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004af93724 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186142080:0@lo:101: 00010000:00010000:0.0:1788666031.002392:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 000000000ec72d82/0x96bbe788361e9771 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9778 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666031.002404:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 000000000ec72d82/0x96bbe788361e9771 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9778 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666031.002483:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004af93724 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186142208:0@lo:256: 00000100:00100000:0.0:1788666031.002558:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666031.002629:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set 0000000002be0451 going to sleep for 11 seconds 00000100:00100000:2.0:1788666031.002745:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186142208 00000100:00100000:2.0:1788666031.002753:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186142208 00000100:00100000:2.0:1788666031.002804:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788666031.002811:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2132d99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+12:5804:x1875552186142208:12345-0@lo:256: 20000000:01000000:2.0:1788666031.002834:0:5802:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788666031.002851:0:5802:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788666031.002854:0:5802:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788666031.002933:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2132d99 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+12:5804:x1875552186142208:12345-0@lo:256: Request processed in 122us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666031.002941:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788666031.004737:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004af93724 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186142208:0@lo:256: 10000000:01000000:0.0:1788666031.004807:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788666031.004815:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 000000000ec72d82/0x96bbe788361e9771 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9778 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666031.004826:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 000000000ec72d82/0x96bbe788361e9771 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9778 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666031.115257:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788666031.133387:0:6286:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc2bd2b560 20000000:00000080:2.0:1788666031.133404:0:6286:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab2ae377000 uarg=0000000000000000 20000000:01000000:2.0:1788666031.133434:0:6286:0:(mgs_llog.c:6191:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788666031.133441:0:6286:0:(mgs_llog.c:4646:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788666031.133445:0:6286:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788666031.133845:0:6286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788666031.133856:0:6286:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788666031.137237:0:6286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788666031.137849:0:6286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788666031.137902:0:6286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788666031.137964:0:6286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788666031.137982:0:6286:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788666031.138002:0:6286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000061189bda/0x96bbe788361e977f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666031.138024:0:6286:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ef6aadb8/0x96bbe788361e9740 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9739 expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666031.138032:0:6286:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000061189bda/0x96bbe788361e977f lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666031.138096:0:6286:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ef6aadb8/0x96bbe788361e9740 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e9739 expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666031.138112:0:6286:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ef6aadb8/0x96bbe788361e9740 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e9739 expref: 11 pid: 5800 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666031.138128:0:6286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000d49efbf pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6286:1875552186142336:0@lo:104: 00000100:00100000:2.0:1788666031.138212:0:6286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666031.138283:0:6286:0:(client.c:2716:ptlrpc_set_wait()) set 00000000eeebef69 going to sleep for 11 seconds 00000100:00100000:1.0:1788666031.138468:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186142336 00000100:00100000:1.0:1788666031.138476:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186142336 00000100:00100000:1.0:1788666031.138529:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788666031.138547:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0ec6ab2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:633727f4-1aad-4438-919b-34cfb144e459+3:6286:x1875552186142336:12345-0@lo:104: 00010000:00010000:1.0:1788666031.138559:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: 00000000990e788d/0x96bbe788361e9739 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9740 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666031.138641:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788666031.138653:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0ec6ab2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:633727f4-1aad-4438-919b-34cfb144e459+3:6286:x1875552186142336:12345-0@lo:104: Request processed in 111us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666031.138660:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788666031.138811:0:6286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000d49efbf pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6286:1875552186142336:0@lo:104: 00010000:00010000:2.0:1788666031.138829:0:6286:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000061189bda/0x96bbe788361e977f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666031.138988:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666031.138995:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: 00000000990e788d/0x96bbe788361e9739 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9740 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666031.139002:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000990e788d already unused, calling callback (0000000073a16527) 10000000:00010000:0.0:1788666031.139005:0:5797:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: 00000000990e788d/0x96bbe788361e9739 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e9740 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666031.139011:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: 00000000990e788d/0x96bbe788361e9739 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e9740 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788666031.139019:0:5797:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: 00000000990e788d/0x96bbe788361e9739 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e9740 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666031.139024:0:5797:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788666031.139051:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: 00000000990e788d/0x96bbe788361e9739 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9740 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666031.139065:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788666031.139205:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004af93724 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186142464:0@lo:103: 00000100:00100000:2.0:1788666031.139242:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666031.139350:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186142464 00000100:00100000:1.0:1788666031.139356:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186142464 00010000:00010000:1.0:1788666031.139374:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ef6aadb8/0x96bbe788361e9740 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9739 expref: 12 pid: 5800 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666031.139400:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788666031.139407:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d49efbf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:633727f4-1aad-4438-919b-34cfb144e459+12:3278:x1875552186142464:12345-0@lo:103: 00010000:00010000:1.0:1788666031.139417:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666031.139421:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ef6aadb8/0x96bbe788361e9740 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9739 expref: 12 pid: 5800 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666031.139431:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ef6aadb8/0x96bbe788361e9740 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e9739 expref: 12 pid: 5800 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666031.139443:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ef6aadb8/0x96bbe788361e9740 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e9739 expref: 12 pid: 5800 timeout: 287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666031.139464:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000061189bda/0x96bbe788361e977f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666031.139471:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000061189bda/0x96bbe788361e977f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666031.139482:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000061189bda/0x96bbe788361e977f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666031.139488:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000061189bda/0x96bbe788361e977f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666031.139493:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000061189bda/0x96bbe788361e977f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666031.139499:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000061189bda/0x96bbe788361e977f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666031.139504:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000061189bda already unused, calling callback (00000000b9e3307c) 00010000:00010000:1.0:1788666031.139507:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000061189bda/0x96bbe788361e977f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666031.139513:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000061189bda/0x96bbe788361e977f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666031.139526:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000061189bda/0x96bbe788361e977f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666031.139535:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788666031.139599:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: 00000000990e788d/0x96bbe788361e9739 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9740 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666031.139607:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: 00000000990e788d/0x96bbe788361e9739 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9740 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666031.139621:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666031.139622:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666031.139623:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666031.140256:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d49efbf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:633727f4-1aad-4438-919b-34cfb144e459+11:3278:x1875552186142464:12345-0@lo:103: Request processed in 848us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666031.140274:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788666031.140677:0:6286:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000061189bda/0x96bbe788361e977f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666031.140686:0:6286:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000061189bda/0x96bbe788361e977f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666031.140693:0:6286:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000061189bda/0x96bbe788361e977f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666031.144763:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004af93724 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186142464:0@lo:103: 00010000:00010000:1.0:1788666032.138702:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666032.525130:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a388059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186142592:0@lo:400: 00000100:00100000:1.0:1788666032.525949:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b2f4ed82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186142720:0@lo:400: 00000100:00100000:1.0:1788666032.526013:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666032.526104:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186142720 00000100:00100000:1.0:1788666032.526112:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186142720 00000100:00100000:0.0:1788666032.526666:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666032.526700:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186142592 00000100:00100000:0.0:1788666032.526703:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186142592 00000100:00100000:0.0:1788666032.526734:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788666032.526741:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ffee0a15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+11:3275:x1875552186142592:12345-0@lo:400: 00000100:00100000:0.0:1788666032.526783:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ffee0a15 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+11:3275:x1875552186142592:12345-0@lo:400: Request processed in 43us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666032.526788:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788666032.526828:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a388059 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186142592:0@lo:400: 00000100:00100000:1.0:1788666032.527672:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788666032.527680:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000797526ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186142720:12345-0@lo:400: 00000100:00100000:1.0:1788666032.527725:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000797526ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186142720:12345-0@lo:400: Request processed in 47us (1712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666032.527731:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788666032.527764:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b2f4ed82 x1875552186142720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666032.527777:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b2f4ed82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186142720:0@lo:400: 00010000:00010000:2.0:1788666033.165113:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666034.187707:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666035.210917:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666036.235345:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788666037.109828:0:6646:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:3.0:1788666037.109832:0:6646:0:(obd_mount.c:924:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788666037.109966:0:6646:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000927a80ee 00000020:01000004:3.0:1788666037.109982:0:6646:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788666037.109994:0:6646:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788666037.110008:0:6646:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000fe82f744) 00000020:00000080:3.0:1788666037.110024:0:6646:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788666037.153280:0:6646:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788666037.154981:0:6646:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788666037.193842:0:6646:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788666037.207398:0:6646:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788666037.207435:0:6646:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788666037.207488:0:6646:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788666037.207515:0:6646:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788666037.207871:0:6646:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788666037.207883:0:6646:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788666037.207899:0:6646:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x96bbe788361e978d 00000020:01000004:2.0:1788666037.207907:0:6646:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788666037.207929:0:6646:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.125@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788666037.207938:0:6646:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.201.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788666037.207944:0:6646:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788666037.207949:0:6646:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788666037.207959:0:6646:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000e447cd50) 00000020:00000080:2.0:1788666037.207971:0:6646:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1788666037.215969:0:6646:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788666037.216748:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788666037.216755:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788666037.219574:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788666037.219608:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788666037.219898:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788666037.219904:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788666037.220979:0:6646:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788666037.221154:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788666037.221159:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788666037.222045:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788666037.222052:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:2.0:1788666037.258722:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666037.266437:0:6646:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788666037.266727:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788666037.266734:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788666037.270415:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788666037.270431:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788666037.286265:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788666037.286281:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788666037.289990:0:6646:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788666037.290211:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788666037.290218:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788666037.290990:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788666037.290998:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788666037.401352:0:6646:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788666037.401680:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788666037.401686:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788666037.403875:0:6646:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788666037.403890:0:6646:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788666037.404296:0:6646:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788666037.404320:0:6646:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788666037.404327:0:6646:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.125@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788666037.447092:0:6646:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788666037.447149:0:6646:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.125@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1788666037.447154:0:6646:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788666037.447156:0:6646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788666037.447158:0:6646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666037.447160:0:6646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666037.447161:0:6646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666037.447163:0:6646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666037.447164:0:6646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788666037.447165:0:6646:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788666037.447167:0:6646:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788666037.447174:0:6646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666037.447175:0:6646:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788666037.447178:0:6646:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1788666037.447180:0:6646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788666037.447181:0:6646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788666037.447182:0:6646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666037.447182:0:6646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666037.447183:0:6646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666037.447184:0:6646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666037.447185:0:6646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788666037.447186:0:6646:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788666037.447186:0:6646:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788666037.447187:0:6646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666037.447188:0:6646:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788666037.447215:0:6646:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788666037.447248:0:6646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fa14834f pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186142848:0@lo:253: 00000100:00100000:3.0:1788666037.447333:0:6646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666037.447393:0:6646:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f37b9581 going to sleep for 11 seconds 00000100:00100000:0.0:1788666037.447530:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186142848 00000100:00100000:0.0:1788666037.447539:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186142848 00000100:00100000:0.0:1788666037.447618:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788666037.447627:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e8bf0e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+11:6646:x1875552186142848:12345-0@lo:253: 20000000:01000000:0.0:1788666037.447656:0:5800:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788666037.447661:0:5800:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788666037.447666:0:5800:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788666037.447668:0:5800:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788666037.448506:0:5800:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788666037.448748:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788666037.448763:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788666037.448805:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788666037.448814:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788666037.448848:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788666037.448902:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788666037.449304:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788666037.449325:0:5800:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.125@tcp 20000000:01000000:0.0:1788666037.449327:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.125@tcp (null) (null) (null) 00000040:00080000:0.0:1788666037.449364:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788666037.449372:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788666037.449423:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788666037.449432:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.125@tcp (null) (null) 00000040:00080000:0.0:1788666037.449467:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788666037.449483:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788666037.449532:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788666037.449614:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788666037.450334:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788666037.450350:0:5800:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.125@tcp 20000000:01000000:0.0:1788666037.450352:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.125@tcp (null) (null) (null) 00000040:00080000:0.0:1788666037.450388:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788666037.450396:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788666037.450430:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788666037.450438:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.125@tcp (null) (null) 00000040:00080000:0.0:1788666037.450486:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788666037.450495:0:5800:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788666037.450529:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788666037.450569:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788666037.450608:0:5800:0:(mgs_llog.c:5251:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788666037.450611:0:5800:0:(mgs_llog.c:4747:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788666037.450618:0:5800:0:(mgs_llog.c:5251:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788666037.450619:0:5800:0:(mgs_llog.c:4747:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788666037.450621:0:5800:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788666037.450635:0:5800:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788666037.450638:0:5800:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788666037.450670:0:5800:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788666037.450673:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788666037.455710:0:6661:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788666037.455796:0:6661:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788666037.455845:0:6661:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788666037.456238:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788666037.456279:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788666037.456312:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1788666037.456326:0:5800:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788666037.456328:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788666037.456951:0:6662:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1788666037.456992:0:6662:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1788666037.457038:0:6662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788666037.460347:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788666037.460418:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788666037.460508:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788666037.460524:0:5800:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788666037.460527:0:5800:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788666037.461332:0:6663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788666037.461728:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788666037.461776:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788666037.461825:0:5800:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1788666037.461842:0:5800:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788666037.461859:0:5800:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ceec2262/0x96bbe788361e979b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666037.461876:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000727a603b/0x96bbe788361e96c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e96bb expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666037.461883:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002625a32f/0x96bbe788361e96de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e96d7 expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666037.461889:0:5800:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b19e7a2f/0x96bbe788361e974e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9747 expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666037.461896:0:5800:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ceec2262/0x96bbe788361e979b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666037.461929:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b19e7a2f/0x96bbe788361e974e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e9747 expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666037.461942:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b19e7a2f/0x96bbe788361e974e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e9747 expref: 11 pid: 5802 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666037.461955:0:5800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a388059 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1875552186142976:0@lo:104: 00000100:00100000:0.0:1788666037.462017:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788666037.462065:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002625a32f/0x96bbe788361e96de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e96d7 expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666037.462072:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002625a32f/0x96bbe788361e96de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e96d7 expref: 11 pid: 5800 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666037.462104:0:5800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ace353de pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1875552186143104:0@lo:104: 00000100:00100000:0.0:1788666037.462127:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788666037.462153:0:5800:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000727a603b/0x96bbe788361e96c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e96bb expref: 11 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666037.462160:0:5800:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000727a603b/0x96bbe788361e96c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e96bb expref: 11 pid: 5801 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666037.462167:0:5800:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006c454dc4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1875552186143232:0@lo:104: 00000100:00100000:0.0:1788666037.462185:0:5800:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666037.462195:0:5800:0:(client.c:2716:ptlrpc_set_wait()) set 00000000408123d8 going to sleep for 11 seconds 00000100:00100000:1.0:1788666037.462303:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186142976 00000100:00100000:1.0:1788666037.462310:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186142976 00000100:00100000:1.0:1788666037.462341:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186143104 00000100:00100000:1.0:1788666037.462344:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186143104 00000100:00100000:1.0:1788666037.462364:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186143232 00000100:00100000:1.0:1788666037.462366:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186143232 00000100:00100000:1.0:1788666037.462380:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788666037.462387:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ba2a817 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:633727f4-1aad-4438-919b-34cfb144e459+5:5800:x1875552186142976:12345-0@lo:104: 00010000:00010000:1.0:1788666037.462399:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: 00000000bf711f92/0x96bbe788361e9747 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e974e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666037.462468:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788666037.462473:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ba2a817 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:633727f4-1aad-4438-919b-34cfb144e459+5:5800:x1875552186142976:12345-0@lo:104: Request processed in 86us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666037.462480:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788666037.462497:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788666037.462503:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000100f3e9a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:633727f4-1aad-4438-919b-34cfb144e459+4:5800:x1875552186143104:12345-0@lo:104: 00010000:00010000:1.0:1788666037.462509:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: 000000003af76f07/0x96bbe788361e96d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e96de expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666037.462538:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788666037.462542:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000100f3e9a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:633727f4-1aad-4438-919b-34cfb144e459+4:5800:x1875552186143104:12345-0@lo:104: Request processed in 41us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666037.462547:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788666037.462557:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788666037.462561:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a90b895 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:633727f4-1aad-4438-919b-34cfb144e459+3:5800:x1875552186143232:12345-0@lo:104: 00010000:00010000:1.0:1788666037.462567:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: 00000000c047e7da/0x96bbe788361e96bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e96c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666037.462634:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788666037.462640:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a90b895 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:633727f4-1aad-4438-919b-34cfb144e459+3:5800:x1875552186143232:12345-0@lo:104: Request processed in 79us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666037.462648:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788666037.462787:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788666037.462793:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: 00000000bf711f92/0x96bbe788361e9747 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e974e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.462809:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bf711f92 already unused, calling callback (0000000073a16527) 10000000:00010000:2.0:1788666037.462812:0:5796:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: 00000000bf711f92/0x96bbe788361e9747 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e974e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.462818:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: 00000000bf711f92/0x96bbe788361e9747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e974e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788666037.462824:0:5796:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: 00000000bf711f92/0x96bbe788361e9747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e974e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666037.462829:0:5796:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788666037.462855:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: 00000000bf711f92/0x96bbe788361e9747 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e974e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.462863:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788666037.462883:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: 00000000bf711f92/0x96bbe788361e9747 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e974e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.462890:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: 00000000bf711f92/0x96bbe788361e9747 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e974e expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.462905:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788666037.462908:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: 000000003af76f07/0x96bbe788361e96d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e96de expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.462914:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003af76f07 already unused, calling callback (0000000073a16527) 10000000:00010000:2.0:1788666037.462916:0:5796:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: 000000003af76f07/0x96bbe788361e96d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e96de expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.462935:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: 000000003af76f07/0x96bbe788361e96d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e96de expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788666037.462941:0:5796:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: 000000003af76f07/0x96bbe788361e96d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e96de expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666037.462946:0:5796:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788666037.462962:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: 000000003af76f07/0x96bbe788361e96d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e96de expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.462968:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788666037.462973:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: 000000003af76f07/0x96bbe788361e96d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e96de expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.462978:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: 000000003af76f07/0x96bbe788361e96d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e96de expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.462988:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666037.462989:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: 00000000c047e7da/0x96bbe788361e96bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e96c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.462994:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c047e7da already unused, calling callback (0000000073a16527) 10000000:00010000:2.0:1788666037.462996:0:5796:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: 00000000c047e7da/0x96bbe788361e96bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e96c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.463001:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: 00000000c047e7da/0x96bbe788361e96bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e96c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788666037.463005:0:5796:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: 00000000c047e7da/0x96bbe788361e96bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e96c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666037.463016:0:5796:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788666037.463028:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: 00000000c047e7da/0x96bbe788361e96bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e96c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.463033:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788666037.463046:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: 00000000c047e7da/0x96bbe788361e96bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e96c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.463052:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: 00000000c047e7da/0x96bbe788361e96bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e96c2 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.463063:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666037.463065:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666037.463066:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666037.463071:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666037.463091:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff3dd668 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186143488:0@lo:103: 00000100:00100000:2.0:1788666037.463124:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666037.463159:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788666037.463166:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fcf11807 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186143360:0@lo:103: 00000100:00100000:2.0:1788666037.463187:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666037.463207:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788666037.463214:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000934bcbbd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186143616:0@lo:103: 00000100:00100000:2.0:1788666037.463232:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666037.463263:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186143488 00000100:00100000:2.0:1788666037.463268:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186143488 00010000:00010000:2.0:1788666037.463291:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002625a32f/0x96bbe788361e96de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e96d7 expref: 12 pid: 5800 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666037.463309:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186143360 00000100:00100000:2.0:1788666037.463318:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186143360 00010000:00010000:2.0:1788666037.463334:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b19e7a2f/0x96bbe788361e974e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9747 expref: 13 pid: 5802 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666037.463346:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186143616 00000100:00100000:2.0:1788666037.463349:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186143616 00010000:00010000:2.0:1788666037.463376:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000727a603b/0x96bbe788361e96c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e96bb expref: 14 pid: 5801 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666037.463394:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788666037.463402:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065db71d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+14:3278:x1875552186143488:12345-0@lo:103: 00010000:00010000:2.0:1788666037.463412:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666037.463416:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002625a32f/0x96bbe788361e96de lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e96d7 expref: 14 pid: 5800 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.463423:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002625a32f/0x96bbe788361e96de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e96d7 expref: 14 pid: 5800 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.463450:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666037.463476:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065db71d4 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+14:3278:x1875552186143488:12345-0@lo:103: Request processed in 77us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666037.463482:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788666037.463497:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788666037.463502:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca7c13d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+13:3278:x1875552186143360:12345-0@lo:103: 00010000:00010000:2.0:1788666037.463509:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666037.463512:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b19e7a2f/0x96bbe788361e974e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9747 expref: 13 pid: 5802 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.463519:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b19e7a2f/0x96bbe788361e974e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e9747 expref: 13 pid: 5802 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.463540:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666037.463562:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca7c13d0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+13:3278:x1875552186143360:12345-0@lo:103: Request processed in 60us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666037.463567:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788666037.463602:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788666037.463608:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a31cdbbe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+12:3276:x1875552186143616:12345-0@lo:103: 00010000:00010000:2.0:1788666037.463614:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666037.463617:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000727a603b/0x96bbe788361e96c2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e96bb expref: 12 pid: 5801 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.463624:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000727a603b/0x96bbe788361e96c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e96bb expref: 12 pid: 5801 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.463633:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ceec2262/0x96bbe788361e979b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.463639:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ceec2262/0x96bbe788361e979b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.463650:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ceec2262/0x96bbe788361e979b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.463657:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ceec2262/0x96bbe788361e979b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.463663:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ceec2262/0x96bbe788361e979b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.463668:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ceec2262/0x96bbe788361e979b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.463678:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ceec2262 already unused, calling callback (00000000b9e3307c) 00010000:00010000:2.0:1788666037.463681:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ceec2262/0x96bbe788361e979b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.463687:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ceec2262/0x96bbe788361e979b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.463694:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ceec2262/0x96bbe788361e979b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.463703:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666037.463727:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a31cdbbe pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+12:3276:x1875552186143616:12345-0@lo:103: Request processed in 120us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666037.463733:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788666037.463773:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000934bcbbd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186143616:0@lo:103: 00000100:00100000:2.0:1788666037.463795:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fcf11807 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186143360:0@lo:103: 00000100:00100000:2.0:1788666037.463800:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff3dd668 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186143488:0@lo:103: 00010000:00010000:0.0:1788666037.464137:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b19e7a2f/0x96bbe788361e974e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e9747 expref: 11 pid: 5802 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666037.464149:0:5800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a388059 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1875552186142976:0@lo:104: 00010000:00010000:0.0:1788666037.464156:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002625a32f/0x96bbe788361e96de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e96d7 expref: 10 pid: 5800 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666037.464161:0:5800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ace353de pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1875552186143104:0@lo:104: 00010000:00010000:0.0:1788666037.464167:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000727a603b/0x96bbe788361e96c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e96bb expref: 9 pid: 5801 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666037.464173:0:5800:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006c454dc4 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5800:1875552186143232:0@lo:104: 00010000:00010000:0.0:1788666037.464188:0:5800:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ceec2262/0x96bbe788361e979b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666037.464195:0:5800:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ceec2262/0x96bbe788361e979b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666037.464207:0:5800:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ceec2262/0x96bbe788361e979b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666037.464213:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ceec2262/0x96bbe788361e979b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788666037.464399:0:5800:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788666037.536969:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e8bf0e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+8:6646:x1875552186142848:12345-0@lo:253: Request processed in 89337us (89630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666037.536999:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788666037.537174:0:6646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fa14834f pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186142848:0@lo:253: 10000000:01000000:1.0:1788666037.537189:0:6646:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788666037.537193:0:6646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788666037.537195:0:6646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788666037.537196:0:6646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788666037.537197:0:6646:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788666037.537198:0:6646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788666037.537200:0:6646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788666037.537201:0:6646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788666037.537202:0:6646:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788666037.537204:0:6646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788666037.537205:0:6646:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788666037.537223:0:6646:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000927a80ee from lustre-OST0000 10000000:01000000:1.0:1788666037.537256:0:6646:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788666037.537259:0:6646:0:(mgc_request.c:327:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788666037.537266:0:6646:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ab2989a4d40 local copy 10000000:01000000:1.0:1788666037.537270:0:6646:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788666037.537306:0:6646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 0000000078670ac5/0x96bbe788361e97a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666037.537317:0:6646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.125@tcp lock: 0000000078670ac5/0x96bbe788361e97a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666037.537326:0:6646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 0000000078670ac5/0x96bbe788361e97a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666037.537343:0:6646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d247203 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186143744:0@lo:101: 00000100:00100000:1.0:1788666037.537397:0:6646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666037.537468:0:6646:0:(client.c:2716:ptlrpc_set_wait()) set 000000000546758e going to sleep for 11 seconds 00000100:00100000:0.0:1788666037.539287:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186143744 00000100:00100000:0.0:1788666037.539298:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186143744 00000100:00100000:0.0:1788666037.539355:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788666037.539364:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000506136ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+8:6646:x1875552186143744:12345-0@lo:101: 00010000:00010000:0.0:1788666037.539378:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666037.539392:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ceec2262/0x96bbe788361e97a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e97a2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666037.539418:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ceec2262/0x96bbe788361e97a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e97a2 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666037.539436:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ceec2262/0x96bbe788361e97a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e97a2 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666037.539444:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ceec2262, rc 0) 00000100:00100000:0.0:1788666037.539509:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000506136ff pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+9:6646:x1875552186143744:12345-0@lo:101: Request processed in 147us (2112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666037.539515:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788666037.539657:0:6646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d247203 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186143744:0@lo:101: 00010000:00010000:1.0:1788666037.539675:0:6646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 0000000078670ac5/0x96bbe788361e97a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x96bbe788361e97a9 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666037.539683:0:6646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 0000000078670ac5/0x96bbe788361e97a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x96bbe788361e97a9 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666037.539811:0:6646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d247203 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186143872:0@lo:501: 00000100:00100000:1.0:1788666037.539841:0:6646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666037.539875:0:6646:0:(client.c:2716:ptlrpc_set_wait()) set 000000000546758e going to sleep for 11 seconds 00000100:00100000:2.0:1788666037.539936:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186143872 00000100:00100000:2.0:1788666037.539941:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186143872 00000100:00100000:2.0:1788666037.539986:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788666037.539993:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8c84e38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+9:6646:x1875552186143872:12345-0@lo:501: 00000100:00100000:2.0:1788666037.540211:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8c84e38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+9:6646:x1875552186143872:12345-0@lo:501: Request processed in 218us (369us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788666037.540226:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788666037.540255:0:6646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d247203 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186143872:0@lo:501: 10000000:01000000:2.0:1788666037.540266:0:6646:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788666037.540287:0:6646:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788666037.540291:0:6646:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 0000000078670ac5/0x96bbe788361e97a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x96bbe788361e97a9 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.540298:0:6646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 0000000078670ac5/0x96bbe788361e97a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x96bbe788361e97a9 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.540305:0:6646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: 0000000078670ac5/0x96bbe788361e97a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x96bbe788361e97a9 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.540320:0:6646:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788666037.540335:0:6646:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab2bcd59800 10000000:01000000:2.0:1788666037.540339:0:6646:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788666037.540343:0:6646:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8ab2989a4d40 10000000:01000000:2.0:1788666037.540345:0:6646:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788666037.540349:0:6646:0:(mgc_request.c:1800:mgc_process_log()) Process log nodemap-ffff8ab2989a4d40 from 1 10000000:01000000:2.0:1788666037.540351:0:6646:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788666037.540367:0:6646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 00000000c047e7da/0x96bbe788361e97b0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.540373:0:6646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 00000000c047e7da/0x96bbe788361e97b0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.540379:0:6646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 00000000c047e7da/0x96bbe788361e97b0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666037.540402:0:6646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff3dd668 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186144000:0@lo:101: 00000100:00100000:2.0:1788666037.540424:0:6646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666037.540446:0:6646:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078a19611 going to sleep for 11 seconds 00010000:00010000:2.0:1788666037.540458:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666037.540462:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: 0000000078670ac5/0x96bbe788361e97a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x96bbe788361e97a9 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.540470:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000078670ac5 already unused, calling callback (0000000073a16527) 10000000:00010000:2.0:1788666037.540473:0:5796:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: 0000000078670ac5/0x96bbe788361e97a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x96bbe788361e97a9 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.540480:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: 0000000078670ac5/0x96bbe788361e97a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x96bbe788361e97a9 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788666037.540486:0:5796:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: 0000000078670ac5/0x96bbe788361e97a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x96bbe788361e97a9 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666037.540491:0:5796:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788666037.540507:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: 0000000078670ac5/0x96bbe788361e97a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x96bbe788361e97a9 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.540512:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788666037.540526:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: 0000000078670ac5/0x96bbe788361e97a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x96bbe788361e97a9 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.540531:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: 0000000078670ac5/0x96bbe788361e97a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x96bbe788361e97a9 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.540544:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666037.540549:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666037.540551:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666037.540560:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fcf11807 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186144128:0@lo:103: 00000100:00100000:2.0:1788666037.540623:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666037.540656:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186144128 00000100:00100000:2.0:1788666037.540660:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186144128 00000100:00100000:2.0:1788666037.540686:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788666037.540691:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000934bcbbd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+9:3276:x1875552186144128:12345-0@lo:103: 00010000:00010000:2.0:1788666037.540700:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666037.540710:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ceec2262/0x96bbe788361e97a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96bbe788361e97a2 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.540722:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666037.540744:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000934bcbbd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+8:3276:x1875552186144128:12345-0@lo:103: Request processed in 54us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666037.540750:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788666037.540779:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fcf11807 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186144128:0@lo:103: 00000100:00100000:2.0:1788666037.540790:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186144000 00000100:00100000:2.0:1788666037.540792:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186144000 00000100:00100000:2.0:1788666037.540806:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788666037.540811:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000274dcb7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+8:6646:x1875552186144000:12345-0@lo:101: 00010000:00010000:2.0:1788666037.540818:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666037.540825:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003af76f07/0x96bbe788361e97b7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e97b0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.540836:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003af76f07/0x96bbe788361e97b7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e97b0 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.540843:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003af76f07/0x96bbe788361e97b7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e97b0 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.540855:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003af76f07, rc 0) 00000100:00100000:2.0:1788666037.540880:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000274dcb7b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+9:6646:x1875552186144000:12345-0@lo:101: Request processed in 69us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666037.540885:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788666037.540917:0:6646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff3dd668 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186144000:0@lo:101: 00010000:00010000:2.0:1788666037.540926:0:6646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 00000000c047e7da/0x96bbe788361e97b0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e97b7 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.540932:0:6646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 00000000c047e7da/0x96bbe788361e97b0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e97b7 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666037.540946:0:6646:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788666037.540954:0:6646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 00000000c047e7da/0x96bbe788361e97b0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e97b7 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.540959:0:6646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 00000000c047e7da/0x96bbe788361e97b0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e97b7 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666037.540964:0:6646:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788666037.540967:0:6646:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788666037.540970:0:6646:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788666037.540972:0:6646:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788666037.540983:0:6646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 0000000076a7d2e5/0x96bbe788361e97be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.540989:0:6646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 0000000076a7d2e5/0x96bbe788361e97be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.541005:0:6646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 0000000076a7d2e5/0x96bbe788361e97be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666037.541014:0:6646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff3dd668 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186144256:0@lo:101: 00000100:00100000:2.0:1788666037.541036:0:6646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666037.541047:0:6646:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078a19611 going to sleep for 11 seconds 00000100:00100000:2.0:1788666037.541064:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186144256 00000100:00100000:2.0:1788666037.541067:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186144256 00000100:00100000:2.0:1788666037.541095:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788666037.541100:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000d20a87e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+9:6646:x1875552186144256:12345-0@lo:101: 00010000:00010000:2.0:1788666037.541106:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666037.541113:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cb863b3b/0x96bbe788361e97c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e97be expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.541123:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb863b3b/0x96bbe788361e97c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e97be expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.541130:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cb863b3b/0x96bbe788361e97c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e97be expref: 10 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.541136:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cb863b3b, rc 0) 00000100:00100000:2.0:1788666037.541160:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000d20a87e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+10:6646:x1875552186144256:12345-0@lo:101: Request processed in 61us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666037.541165:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788666037.541190:0:6646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff3dd668 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186144256:0@lo:101: 00010000:00010000:2.0:1788666037.541200:0:6646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 0000000076a7d2e5/0x96bbe788361e97be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e97c5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.541216:0:6646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 0000000076a7d2e5/0x96bbe788361e97be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e97c5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666037.541272:0:6646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff3dd668 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186144384:0@lo:501: 00000100:00100000:2.0:1788666037.541294:0:6646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666037.541305:0:6646:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078a19611 going to sleep for 11 seconds 00000100:00100000:2.0:1788666037.541317:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186144384 00000100:00100000:2.0:1788666037.541320:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186144384 00000100:00100000:2.0:1788666037.541336:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788666037.541340:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032256d06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+10:6646:x1875552186144384:12345-0@lo:501: 00000100:00100000:2.0:1788666037.541491:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032256d06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+10:6646:x1875552186144384:12345-0@lo:501: Request processed in 149us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666037.541496:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788666037.541521:0:6646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff3dd668 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186144384:0@lo:501: 00000100:00100000:2.0:1788666037.541544:0:6646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff3dd668 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186144512:0@lo:503: 00000100:00100000:2.0:1788666037.542321:0:6646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666037.542361:0:6646:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078a19611 going to sleep for 11 seconds 00000100:00100000:2.0:1788666037.542382:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186144512 00000100:00100000:2.0:1788666037.542387:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186144512 00000100:00100000:2.0:1788666037.542412:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788666037.542419:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4e1bf1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+10:6646:x1875552186144512:12345-0@lo:503: 00000100:00100000:2.0:1788666037.542603:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4e1bf1d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+10:6646:x1875552186144512:12345-0@lo:503: Request processed in 185us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666037.542610:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788666037.542665:0:6646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff3dd668 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186144512:0@lo:503: 00000040:00080000:2.0:1788666037.542951:0:6646:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788666037.543017:0:6646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff3dd668 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186144640:0@lo:502: 00000100:00100000:2.0:1788666037.543050:0:6646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666037.543069:0:6646:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078a19611 going to sleep for 11 seconds 00000100:00100000:1.0:1788666037.544109:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186144640 00000100:00100000:1.0:1788666037.544119:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186144640 00000100:00100000:1.0:1788666037.544155:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788666037.544161:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029efc4a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+10:6646:x1875552186144640:12345-0@lo:502: 00000100:00100000:1.0:1788666037.549597:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029efc4a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+10:6646:x1875552186144640:12345-0@lo:502: Request processed in 5418us (6528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666037.549614:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788666037.549816:0:6646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff3dd668 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186144640:0@lo:502: 00000040:00080000:2.0:1788666037.550221:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788666037.550350:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788666037.550386:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788666037.550510:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788666037.550551:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788666037.550670:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788666037.550710:0:6646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ff3dd668 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186144768:0@lo:502: 00000100:00100000:2.0:1788666037.550776:0:6646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666037.550861:0:6646:0:(client.c:2716:ptlrpc_set_wait()) set 0000000082a3d8ae going to sleep for 11 seconds 00000100:00100000:0.0:1788666037.556360:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186144768 00000100:00100000:0.0:1788666037.556376:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186144768 00000100:00100000:0.0:1788666037.556535:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788666037.556545:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a582223 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+10:6646:x1875552186144768:12345-0@lo:502: 00000100:00100000:0.0:1788666037.558109:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a582223 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+10:6646:x1875552186144768:12345-0@lo:502: Request processed in 1559us (7325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666037.558124:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788666037.558505:0:6646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ff3dd668 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186144768:0@lo:502: 00000040:00080000:3.0:1788666037.558703:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788666037.558722:0:6646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788666037.560040:0:6664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788666037.560051:0:6664:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788666037.560058:0:6664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666037.560060:0:6664:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788666037.560066:0:6664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788666037.560090:0:6664:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000317d378a) 00000020:00000080:2.0:1788666037.560111:0:6664:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788666037.560117:0:6664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788666037.560203:0:6664:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000927a80ee from lustre-OST0000, refs=2 00080000:01000000:2.0:1788666037.560211:0:6664:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788666037.560217:0:6664:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x96bbe788361e97d3 00010000:00010000:2.0:1788666037.564863:0:6664:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788666037.565368:0:6664:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788666037.567711:0:6664:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788666037.568923:0:6664:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788666037.577196:0:6664:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788666037.578198:0:6664:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788666037.579967:0:6664:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788666037.580708:0:6664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788666037.580715:0:6664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666037.580717:0:6664:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788666037.580721:0:6664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788666037.580725:0:6664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666037.580726:0:6664:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788666037.580729:0:6664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788666037.580731:0:6664:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788666037.580786:0:6664:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788666037.580789:0:6664:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666037.580790:0:6664:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788666037.580793:0:6664:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788666037.588659:0:6646:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788666037.588708:0:6646:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788666037.589044:0:6646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: 0000000076a7d2e5/0x96bbe788361e97be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e97c5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.589058:0:6646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: 0000000076a7d2e5/0x96bbe788361e97be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e97c5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666037.589067:0:6646:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff8ab2bcd59800 from 1 10000000:01000000:3.0:1788666037.589070:0:6646:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788666037.589123:0:6646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: 00000000ddc33ef1/0x96bbe788361e97da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.589144:0:6646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: 00000000ddc33ef1/0x96bbe788361e97da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.589155:0:6646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: 00000000ddc33ef1/0x96bbe788361e97da lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666037.589177:0:6646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067ab6d11 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186144896:0@lo:101: 00000100:00100000:3.0:1788666037.589256:0:6646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666037.589305:0:6646:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017efd7ec going to sleep for 11 seconds 00000100:00100000:2.0:1788666037.589418:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186144896 00000100:00100000:2.0:1788666037.589435:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186144896 00000100:00100000:2.0:1788666037.589482:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788666037.589490:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a36a4e58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+10:6646:x1875552186144896:12345-0@lo:101: 00010000:00010000:2.0:1788666037.589503:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666037.589516:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b19e7a2f/0x96bbe788361e97e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e97da expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.589537:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b19e7a2f/0x96bbe788361e97e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e97da expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.589545:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b19e7a2f/0x96bbe788361e97e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e97da expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.589553:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b19e7a2f, rc 0) 00000100:00100000:2.0:1788666037.589614:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a36a4e58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+11:6646:x1875552186144896:12345-0@lo:101: Request processed in 125us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666037.589630:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788666037.589770:0:6646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067ab6d11 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186144896:0@lo:101: 00010000:00010000:3.0:1788666037.589783:0:6646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: 00000000ddc33ef1/0x96bbe788361e97da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e97e1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.589792:0:6646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: 00000000ddc33ef1/0x96bbe788361e97da lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e97e1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666037.589879:0:6646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000067ab6d11 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186145024:0@lo:501: 00000100:00100000:3.0:1788666037.589904:0:6646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666037.589930:0:6646:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017efd7ec going to sleep for 11 seconds 00000100:00100000:2.0:1788666037.590853:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186145024 00000100:00100000:2.0:1788666037.590861:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186145024 00000100:00100000:2.0:1788666037.590897:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788666037.590904:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002651adfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+11:6646:x1875552186145024:12345-0@lo:501: 00000100:00100000:2.0:1788666037.591195:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002651adfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+11:6646:x1875552186145024:12345-0@lo:501: Request processed in 291us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666037.591203:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788666037.591353:0:6646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000067ab6d11 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186145024:0@lo:501: 00000100:00100000:2.0:1788666037.591387:0:6646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fcf11807 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186145152:0@lo:503: 00000100:00100000:2.0:1788666037.591423:0:6646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666037.591506:0:6646:0:(client.c:2716:ptlrpc_set_wait()) set 000000003e042450 going to sleep for 11 seconds 00000100:00100000:3.0:1788666037.591565:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186145152 00000100:00100000:3.0:1788666037.591569:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186145152 00000100:00100000:3.0:1788666037.591610:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788666037.591615:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f031463d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+11:6646:x1875552186145152:12345-0@lo:503: 00000100:00100000:3.0:1788666037.591887:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f031463d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+11:6646:x1875552186145152:12345-0@lo:503: Request processed in 272us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666037.591893:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788666037.592536:0:6646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fcf11807 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186145152:0@lo:503: 00000040:00080000:2.0:1788666037.592816:0:6646:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788666037.592884:0:6646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fcf11807 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186145280:0@lo:502: 00000100:00100000:2.0:1788666037.592928:0:6646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666037.592956:0:6646:0:(client.c:2716:ptlrpc_set_wait()) set 000000003e042450 going to sleep for 11 seconds 00000100:00100000:1.0:1788666037.593307:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186145280 00000100:00100000:1.0:1788666037.593314:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186145280 00000100:00100000:1.0:1788666037.593388:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788666037.593395:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000190777b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+11:6646:x1875552186145280:12345-0@lo:502: 00000100:00100000:1.0:1788666037.593627:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000190777b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+11:6646:x1875552186145280:12345-0@lo:502: Request processed in 233us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666037.593635:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788666037.593871:0:6646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fcf11807 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186145280:0@lo:502: 00000040:00080000:3.0:1788666037.594156:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788666037.594211:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788666037.594374:0:6646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005d5990b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186145408:0@lo:502: 00000100:00100000:3.0:1788666037.594420:0:6646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666037.594522:0:6646:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a51fc49f going to sleep for 11 seconds 00000100:00100000:1.0:1788666037.594574:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186145408 00000100:00100000:1.0:1788666037.594710:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186145408 00000100:00100000:1.0:1788666037.594781:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788666037.594789:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a54a463 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+11:6646:x1875552186145408:12345-0@lo:502: 00000100:00100000:1.0:1788666037.594949:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a54a463 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+11:6646:x1875552186145408:12345-0@lo:502: Request processed in 161us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666037.594957:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788666037.595033:0:6646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005d5990b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186145408:0@lo:502: 00000040:00080000:3.0:1788666037.595135:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788666037.595146:0:6646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788666037.596384:0:6668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788666037.596396:0:6668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666037.596399:0:6668:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788666037.596406:0:6668:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab2bcd59800 00000020:00000080:2.0:1788666037.596408:0:6668:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788666037.597202:0:6668:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788666037.597208:0:6668:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666037.597210:0:6668:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788666037.597213:0:6668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788666037.597415:0:6646:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788666037.597503:0:6646:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788666037.597555:0:6646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe400/0x96bbe788361e97da lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e97e1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.597566:0:6646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe400/0x96bbe788361e97da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e97e1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666037.597632:0:6646:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788666037.597635:0:6646:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff8ab2bcd59800 10000000:01000000:3.0:1788666037.597638:0:6646:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab2bcd59800 10000000:01000000:3.0:1788666037.597642:0:6646:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788666037.597647:0:6646:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff8ab2bcd59800 from 1 10000000:01000000:3.0:1788666037.597650:0:6646:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788666037.597683:0:6646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff400/0x96bbe788361e97e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.597692:0:6646:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff400/0x96bbe788361e97e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.597703:0:6646:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff400/0x96bbe788361e97e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666037.597737:0:6646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186145536:0@lo:101: 00000100:00100000:3.0:1788666037.597803:0:6646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666037.597841:0:6646:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29885ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666037.597919:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186145536 00000100:00100000:2.0:1788666037.597933:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186145536 00000100:00100000:2.0:1788666037.598067:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788666037.598088:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+11:6646:x1875552186145536:12345-0@lo:101: 00010000:00010000:2.0:1788666037.598103:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666037.598116:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab283fd5600/0x96bbe788361e97ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e97e8 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.598140:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab283fd5600/0x96bbe788361e97ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e97e8 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.598151:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab283fd5600/0x96bbe788361e97ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e97e8 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.598159:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd5600, rc 0) 00000100:00100000:2.0:1788666037.598212:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+12:6646:x1875552186145536:12345-0@lo:101: Request processed in 136us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666037.598218:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788666037.598412:0:6646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186145536:0@lo:101: 00010000:00010000:3.0:1788666037.598493:0:6646:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff400/0x96bbe788361e97e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e97ef expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.598503:0:6646:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff400/0x96bbe788361e97e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e97ef expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666037.598615:0:6646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186145664:0@lo:501: 00000100:00100000:3.0:1788666037.598641:0:6646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666037.598707:0:6646:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29885ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788666037.598817:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186145664 00000100:00100000:1.0:1788666037.598822:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186145664 00000100:00100000:1.0:1788666037.598872:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788666037.598879:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+12:6646:x1875552186145664:12345-0@lo:501: 00000100:00100000:1.0:1788666037.599213:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+12:6646:x1875552186145664:12345-0@lo:501: Request processed in 334us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666037.599220:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788666037.599337:0:6646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186145664:0@lo:501: 00000100:00100000:3.0:1788666037.599364:0:6646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186145792:0@lo:503: 00000100:00100000:3.0:1788666037.599401:0:6646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666037.599510:0:6646:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29885ff00 going to sleep for 11 seconds 00000100:00100000:1.0:1788666037.599541:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186145792 00000100:00100000:1.0:1788666037.599545:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186145792 00000100:00100000:1.0:1788666037.599651:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788666037.599659:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+12:6646:x1875552186145792:12345-0@lo:503: 00000100:00100000:1.0:1788666037.599803:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+12:6646:x1875552186145792:12345-0@lo:503: Request processed in 145us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666037.599810:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788666037.599900:0:6646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186145792:0@lo:503: 00000040:00080000:3.0:1788666037.600194:0:6646:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788666037.600274:0:6646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186145920:0@lo:502: 00000100:00100000:3.0:1788666037.600313:0:6646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666037.600563:0:6646:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29885ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788666037.600729:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186145920 00000100:00100000:0.0:1788666037.600735:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186145920 00000100:00100000:0.0:1788666037.600760:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788666037.600767:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+12:6646:x1875552186145920:12345-0@lo:502: 00000100:00100000:0.0:1788666037.600933:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+12:6646:x1875552186145920:12345-0@lo:502: Request processed in 167us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666037.600940:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788666037.601055:0:6646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186145920:0@lo:502: 00000040:00080000:3.0:1788666037.601315:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788666037.601371:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788666037.601406:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788666037.601464:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788666037.601499:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788666037.601541:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788666037.601572:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788666037.601643:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788666037.601691:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788666037.601726:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788666037.601759:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788666037.601819:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788666037.601861:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788666037.601899:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788666037.601951:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788666037.602199:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788666037.602254:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788666037.602309:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788666037.602350:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788666037.602385:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788666037.602526:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788666037.602566:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788666037.602618:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788666037.602681:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788666037.602712:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788666037.602743:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788666037.602792:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788666037.602827:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1788666037.602862:0:6646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186146048:0@lo:502: 00000100:00100000:3.0:1788666037.602919:0:6646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666037.602956:0:6646:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29885ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1788666037.603111:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186146048 00000100:00100000:0.0:1788666037.603119:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186146048 00000100:00100000:0.0:1788666037.603153:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788666037.603162:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+12:6646:x1875552186146048:12345-0@lo:502: 00000100:00100000:0.0:1788666037.603371:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+12:6646:x1875552186146048:12345-0@lo:502: Request processed in 209us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666037.603379:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788666037.603571:0:6646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186146048:0@lo:502: 00000040:00080000:3.0:1788666037.603661:0:6646:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788666037.603679:0:6646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788666037.604942:0:6669:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788666037.604959:0:6669:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8ab2a0cab380) 00000020:00000080:0.0:1788666037.604993:0:6669:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1788666037.605098:0:6669:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab2bcd59800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788666037.605103:0:6669:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab2bcd59800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788666037.605105:0:6669:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab2bcd59800 3 00010000:00080000:0.0:1788666037.605135:0:6669:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab1811f6800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.125@tcp at head 00010000:00010000:0.0:1788666037.608050:0:6669:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1788666037.608331:0:6669:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788666037.608366:0:6669:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788666037.608383:0:6669:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x96bbe788361e97fd 00000100:00080000:0.0:1788666037.608394:0:6669:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788666037.608401:0:6669:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ab1811f6800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1788666037.608699:0:6669:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab2989fed80 x1875552186146176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788666037.608725:0:6669:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788666037.608811:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3274:1875552186146176:0@lo:38: 00000100:00100000:1.0:1788666037.608876:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788666037.609149:0:6669:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000100:00100000:2.0:1788666037.609480:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788666037.609489:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875552186146304:0@lo:400: 00000100:00100000:2.0:1788666037.609528:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666037.609567:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186146176 00000100:00100000:2.0:1788666037.609573:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186146176 00000100:00100000:2.0:1788666037.609625:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186146304 00000100:00100000:2.0:1788666037.609629:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186146304 00000100:00100000:2.0:1788666037.609652:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788666037.609660:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875552186146304:12345-0@lo:400: 00000100:00100000:2.0:1788666037.609709:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875552186146304:12345-0@lo:400: Request processed in 49us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666037.609716:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788666037.609737:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788666037.609741:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b422aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3274:x1875552186146176:12345-0@lo:38: 00010000:00080000:2.0:1788666037.609762:0:5809:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 144 last 0 00000020:00000080:2.0:1788666037.609798:0:5809:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x96bbe788361e9804 00000004:00100000:2.0:1788666037.609812:0:5809:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788666037.609839:0:5809:0:(import.c:65:import_set_state_nolock()) ffff8ab2bfc1e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788666037.609871:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b422aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875552186146176:12345-0@lo:38: Request processed in 130us (996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666037.609877:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788666037.609913:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ab2989fed80 x1875552186146176/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788666047 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666037.609925:0:3274:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788666037.609933:0:3274:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788666037.609939:0:3274:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788666037.609943:0:3274:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788666037.609945:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab1811f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788666037.609951:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3274:1875552186146176:0@lo:38: 00010000:00080000:2.0:1788666037.610164:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ab2ae841f80 x1875552186146304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666037.610174:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875552186146304:0@lo:400: 00000020:01000000:2.0:1788666037.610655:0:6646:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788666037.610684:0:6646:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788666037.610740:0:6646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff400/0x96bbe788361e97e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e97ef expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.610752:0:6646:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff400/0x96bbe788361e97e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e97ef expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788666037.610812:0:6646:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788666037.610814:0:6646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788666037.610815:0:6646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788666037.610817:0:6646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788666037.610818:0:6646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788666037.610819:0:6646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788666037.610821:0:6646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788666037.610822:0:6646:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788666037.610823:0:6646:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788666037.610825:0:6646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788666037.610827:0:6646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788666037.610830:0:6646:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788666037.610833:0:6646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788666037.610834:0:6646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788666037.610835:0:6646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788666037.610836:0:6646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788666037.610837:0:6646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788666037.610838:0:6646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788666037.610839:0:6646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788666037.610840:0:6646:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788666037.610840:0:6646:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788666037.610841:0:6646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788666037.610842:0:6646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788666037.610857:0:6646:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788666037.610868:0:6646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae841f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186146432:0@lo:253: 00000100:00100000:2.0:1788666037.610909:0:6646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666037.610944:0:6646:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab290587d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788666037.610992:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186146432 00000100:00100000:1.0:1788666037.610997:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186146432 00000100:00100000:1.0:1788666037.611035:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788666037.611042:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+12:6646:x1875552186146432:12345-0@lo:253: 20000000:01000000:1.0:1788666037.611071:0:5800:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788666037.611102:0:5800:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788666037.672553:0:5800:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788666037.672573:0:5800:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788666037.672652:0:5824:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788666037.672665:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788666037.672687:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e980b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.672705:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab283fd4600/0x96bbe788361e9778 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9771 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.672713:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e980b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.672751:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab283fd4600/0x96bbe788361e9778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e9771 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.672765:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab283fd4600/0x96bbe788361e9778 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e9771 expref: 12 pid: 5800 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666037.672778:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5824:1875552186146560:0@lo:104: 00000100:00100000:3.0:1788666037.672841:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666037.672908:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29885f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788666037.673116:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186146560 00000100:00100000:2.0:1788666037.673186:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186146560 00000100:00100000:2.0:1788666037.673237:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788666037.673247:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:633727f4-1aad-4438-919b-34cfb144e459+3:5824:x1875552186146560:12345-0@lo:104: 00010000:00010000:2.0:1788666037.673261:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab280030600/0x96bbe788361e9771 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9778 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.673329:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788666037.673334:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:633727f4-1aad-4438-919b-34cfb144e459+3:5824:x1875552186146560:12345-0@lo:104: Request processed in 90us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666037.673341:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1788666037.673362:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666037.673367:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab280030600/0x96bbe788361e9771 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9778 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.673375:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab280030600 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:2.0:1788666037.673379:0:5797:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab280030600/0x96bbe788361e9771 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e9778 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.673387:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab280030600/0x96bbe788361e9771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e9778 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788666037.673393:0:5797:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab280030600/0x96bbe788361e9771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e9778 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666037.673398:0:5797:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788666037.675405:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab280030600/0x96bbe788361e9771 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9778 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.675603:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788666037.675630:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab280030600/0x96bbe788361e9771 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9778 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.675638:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab280030600/0x96bbe788361e9771 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9778 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666037.676115:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666037.676146:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186146688:0@lo:103: 00000100:00100000:2.0:1788666037.676216:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666037.676288:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5824:1875552186146560:0@lo:104: 00010000:00010000:2.0:1788666037.676325:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e980b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666037.676411:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666037.676414:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666037.676416:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666037.678723:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186146688 00000100:00100000:3.0:1788666037.678740:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186146688 00010000:00010000:3.0:1788666037.678794:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab283fd4600/0x96bbe788361e9778 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9771 expref: 13 pid: 5800 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666037.678837:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788666037.678847:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b9dd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:633727f4-1aad-4438-919b-34cfb144e459+13:3277:x1875552186146688:12345-0@lo:103: 00010000:00010000:3.0:1788666037.678877:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666037.678884:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab283fd4600/0x96bbe788361e9778 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9771 expref: 13 pid: 5800 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.678922:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab283fd4600/0x96bbe788361e9778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e9771 expref: 13 pid: 5800 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.678944:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab283fd4600/0x96bbe788361e9778 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e9771 expref: 13 pid: 5800 timeout: 294 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.678966:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e980b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.678987:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e980b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788666037.679008:0:5794:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006344356s 00010000:00010000:3.0:1788666037.679014:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e980b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.679023:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e980b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.679032:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e980b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.679040:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e980b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.679047:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ffc00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666037.679052:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e980b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.679062:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e980b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.679108:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e980b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.679121:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666037.679210:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b9dd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:633727f4-1aad-4438-919b-34cfb144e459+12:3277:x1875552186146688:12345-0@lo:103: Request processed in 364us (2993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666037.679217:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788666037.679476:0:5824:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e980b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666037.679486:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e980b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666037.679494:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e980b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666037.680333:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186146688:0@lo:103: 00000100:00100000:0.0:1788666037.690624:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+11:6646:x1875552186146432:12345-0@lo:253: Request processed in 79575us (79706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666037.690638:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788666037.690771:0:6646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae841f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:6646:1875552186146432:0@lo:253: 10000000:01000000:2.0:1788666037.690785:0:6646:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788666037.690788:0:6646:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788666037.690789:0:6646:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788666037.690790:0:6646:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788666037.690792:0:6646:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788666037.690793:0:6646:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788666037.690794:0:6646:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788666037.690796:0:6646:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788666037.690797:0:6646:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788666037.690799:0:6646:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788666037.690800:0:6646:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788666037.690801:0:6646:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788666037.690815:0:6646:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788666037.696422:0:6646:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788666037.696667:0:6646:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788666037.696850:0:6646:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 10000000:01000000:0.0:1788666037.697230:0:5804:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788666037.697235:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff8ab290a54800 from 21 10000000:01000000:0.0:1788666037.697239:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788666037.697281:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab280030e00/0x96bbe788361e9812 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666037.697292:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab280030e00/0x96bbe788361e9812 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666037.697304:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab280030e00/0x96bbe788361e9812 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666037.697331:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186146816:0@lo:101: 00000100:00100000:0.0:1788666037.697409:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666037.697483:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab181165900 going to sleep for 11 seconds 00000100:00100000:3.0:1788666037.697555:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186146816 00000100:00100000:3.0:1788666037.697564:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186146816 00000100:00100000:3.0:1788666037.697630:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788666037.697639:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+11:5804:x1875552186146816:12345-0@lo:101: 00010000:00010000:3.0:1788666037.697653:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666037.697665:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2814fe600/0x96bbe788361e9819 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e9812 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.697686:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2814fe600/0x96bbe788361e9819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e9812 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.697695:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2814fe600/0x96bbe788361e9819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9812 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.697704:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814fe600, rc 0) 00000100:00100000:3.0:1788666037.697746:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+12:5804:x1875552186146816:12345-0@lo:101: Request processed in 109us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666037.697753:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788666037.698241:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186146816:0@lo:101: 00010000:00010000:0.0:1788666037.698256:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab280030e00/0x96bbe788361e9812 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9819 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666037.698266:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab280030e00/0x96bbe788361e9812 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9819 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666037.698315:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186146944:0@lo:501: 00000100:00100000:0.0:1788666037.698344:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666037.698374:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab181165900 going to sleep for 11 seconds 00000100:00100000:3.0:1788666037.698435:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186146944 00000100:00100000:3.0:1788666037.698440:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186146944 00000100:00100000:3.0:1788666037.698469:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788666037.698485:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+12:5804:x1875552186146944:12345-0@lo:501: 00000100:00100000:3.0:1788666037.698729:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+12:5804:x1875552186146944:12345-0@lo:501: Request processed in 243us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666037.698736:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788666037.698874:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186146944:0@lo:501: 00000100:00100000:0.0:1788666037.698900:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186147072:0@lo:503: 00000100:00100000:0.0:1788666037.698935:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666037.698962:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab181165900 going to sleep for 11 seconds 00000100:00100000:3.0:1788666037.699105:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186147072 00000100:00100000:3.0:1788666037.699109:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186147072 00000100:00100000:3.0:1788666037.699144:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788666037.699151:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+12:5804:x1875552186147072:12345-0@lo:503: 00080000:10000000:2.0:1788666037.699608:0:6646:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788666037.700190:0:6646:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788666037.700436:0:6646:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000100:00100000:3.0:1788666037.701416:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+12:5804:x1875552186147072:12345-0@lo:503: Request processed in 2259us (2473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666037.701437:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788666037.701794:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186147072:0@lo:503: 00000100:00100000:1.0:1788666037.702411:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4228a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:6673:1875552186147200:0@lo:502: 00000100:00100000:1.0:1788666037.702489:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666037.702525:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a17b7480 going to sleep for 11 seconds 00000100:00100000:3.0:1788666037.702627:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186147200 00000100:00100000:3.0:1788666037.702635:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186147200 00000100:00100000:3.0:1788666037.702664:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788666037.702673:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+12:6673:x1875552186147200:12345-0@lo:502: 00000100:00100000:3.0:1788666037.702896:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+12:6673:x1875552186147200:12345-0@lo:502: Request processed in 223us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666037.702902:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788666037.703101:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4228a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:6673:1875552186147200:0@lo:502: 00000100:00100000:1.0:1788666037.703154:0:6673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4228a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:6673:1875552186147328:0@lo:502: 00000100:00100000:1.0:1788666037.703187:0:6673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666037.703213:0:6673:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab290380b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788666037.703311:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186147328 00000100:00100000:3.0:1788666037.703316:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186147328 00000100:00100000:3.0:1788666037.703334:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788666037.703340:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+12:6673:x1875552186147328:12345-0@lo:502: 00000100:00100000:3.0:1788666037.703481:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+12:6673:x1875552186147328:12345-0@lo:502: Request processed in 141us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666037.703488:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788666037.703618:0:6673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4228a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:6673:1875552186147328:0@lo:502: 00000040:00080000:1.0:1788666037.703637:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788666037.703806:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788666037.703824:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788666037.703839:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab280030e00/0x96bbe788361e9812 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9819 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.703849:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab280030e00/0x96bbe788361e9812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9819 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666037.703857:0:5804:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788666037.703859:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff8ab290a54800 from 4 10000000:01000000:3.0:1788666037.703872:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788666037.703897:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e9820 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.703904:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e9820 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.703913:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e9820 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666037.703925:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186147456:0@lo:101: 00000100:00100000:3.0:1788666037.703954:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666037.703997:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29885f480 going to sleep for 11 seconds 00000100:00100000:1.0:1788666037.704421:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186147456 00000100:00100000:1.0:1788666037.704438:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186147456 00000100:00100000:1.0:1788666037.704464:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788666037.704471:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+12:5804:x1875552186147456:12345-0@lo:101: 00010000:00010000:1.0:1788666037.704482:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666037.704496:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2a1d7c400/0x96bbe788361e9827 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e9820 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666037.704515:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2a1d7c400/0x96bbe788361e9827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e9820 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666037.704526:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2a1d7c400/0x96bbe788361e9827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9820 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666037.704534:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2a1d7c400, rc 0) 00000100:00100000:1.0:1788666037.704612:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+13:5804:x1875552186147456:12345-0@lo:101: Request processed in 141us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666037.704618:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788666037.704750:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186147456:0@lo:101: 00010000:00010000:3.0:1788666037.704763:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e9820 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9827 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.704772:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e9820 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9827 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666037.704816:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186147584:0@lo:256: 00000100:00100000:3.0:1788666037.704855:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666037.704892:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29885f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788666037.704970:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186147584 00000100:00100000:0.0:1788666037.704976:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186147584 00000100:00100000:0.0:1788666037.705154:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788666037.705164:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+13:5804:x1875552186147584:12345-0@lo:256: 20000000:01000000:0.0:1788666037.705181:0:5801:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788666037.705198:0:5801:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788666037.705202:0:5801:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788666037.705285:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+13:5804:x1875552186147584:12345-0@lo:256: Request processed in 123us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666037.705618:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186147584:0@lo:256: 10000000:01000000:1.0:1788666037.705658:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788666037.705664:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e9820 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9827 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666037.705672:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e9820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9827 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666037.705679:0:5804:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788666037.705681:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788666037.705684:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788666037.705705:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c000/0x96bbe788361e982e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666037.705713:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c000/0x96bbe788361e982e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666037.705720:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c000/0x96bbe788361e982e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666037.705732:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4228a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186147712:0@lo:101: 00000100:00100000:1.0:1788666037.705760:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666037.705774:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab290380b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788666037.705786:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186147712 00000100:00100000:1.0:1788666037.705790:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186147712 00000001:00000004:2.0:1788666037.707357:0:6646:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788666037.710056:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788666037.712139:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788666037.712157:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+13:5804:x1875552186147712:12345-0@lo:101: 00010000:00010000:1.0:1788666037.712185:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666037.712202:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2a1d7ce00/0x96bbe788361e9835 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e982e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666037.712233:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2a1d7ce00/0x96bbe788361e9835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e982e expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666037.712246:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2a1d7ce00/0x96bbe788361e9835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e982e expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666037.712255:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2a1d7ce00, rc 0) 00000100:00100000:1.0:1788666037.712333:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+14:5804:x1875552186147712:12345-0@lo:101: Request processed in 183us (6572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666037.712340:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788666037.712384:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4228a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186147712:0@lo:101: 00010000:00010000:1.0:1788666037.712402:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c000/0x96bbe788361e982e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9835 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666037.712412:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c000/0x96bbe788361e982e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9835 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666037.712486:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4228a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186147840:0@lo:501: 00000100:00100000:1.0:1788666037.712520:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666037.712551:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab290380b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788666037.712569:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186147840 00000100:00100000:1.0:1788666037.712575:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186147840 00000100:00100000:1.0:1788666037.712619:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788666037.712625:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+14:5804:x1875552186147840:12345-0@lo:501: 00000100:00100000:1.0:1788666037.712845:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+14:5804:x1875552186147840:12345-0@lo:501: Request processed in 218us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666037.712872:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788666037.712896:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4228a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186147840:0@lo:501: 00000100:00100000:1.0:1788666037.712923:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4228a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186147968:0@lo:503: 00000100:00100000:1.0:1788666037.712962:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666037.712971:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab290380b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788666037.712987:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186147968 00000100:00100000:1.0:1788666037.712991:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186147968 00000100:00100000:1.0:1788666037.713007:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788666037.713013:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+14:5804:x1875552186147968:12345-0@lo:503: 00000100:00100000:1.0:1788666037.713161:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+14:5804:x1875552186147968:12345-0@lo:503: Request processed in 147us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666037.713168:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788666037.713197:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4228a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186147968:0@lo:503: 00000100:00100000:3.0:1788666037.719729:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:6674:1875552186148096:0@lo:502: 00000100:00100000:3.0:1788666037.719825:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666037.719875:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186148096 00000100:00100000:3.0:1788666037.719883:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186148096 00000100:00100000:3.0:1788666037.719931:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788666037.719939:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+14:6674:x1875552186148096:12345-0@lo:502: 00000100:00100000:3.0:1788666037.720427:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+14:6674:x1875552186148096:12345-0@lo:502: Request processed in 487us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666037.720435:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788666037.720493:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab282a6ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1788666037.720516:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:6674:1875552186148096:0@lo:502: 00000020:01000000:3.0:1788666037.720547:0:6674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788666037.720555:0:6674:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788666037.720562:0:6674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666037.720565:0:6674:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788666037.720570:0:6674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788666037.720574:0:6674:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.125@tcp to nid 0x20000c0a8c97d (192.168.201.125@tcp) 00000020:01000000:3.0:1788666037.720615:0:6674:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788666037.720618:0:6674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788666037.720631:0:6674:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ab2989a3380) 00000020:00000080:3.0:1788666037.720651:0:6674:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788666037.720656:0:6674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788666037.720735:0:6674:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788666037.720741:0:6674:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788666037.720748:0:6674:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96bbe788361e9843 00010000:00080000:3.0:1788666037.720783:0:6674:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab1811e0800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.125@tcp at head 00010000:00010000:3.0:1788666037.721689:0:6674:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788666037.895332:0:6674:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788666037.895355:0:6674:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788666037.896670:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788666037.896852:0:6674:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788666037.896902:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788666037.896984:0:6674:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788666037.897410:0:6675:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788666037.897415:0:6675:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788666037.898123:0:6674:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788666037.898136:0:6674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788666037.898170:0:6674:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788666037.898192:0:6674:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96bbe788361e984a 00000100:00080000:3.0:1788666037.898202:0:6674:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788666037.898208:0:6674:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ab1811e0800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:3.0:1788666037.898244:0:6674:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab2b46b7b80 x1875552186148224/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788666037.898265:0:6674:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788666037.898314:0:6674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666037.898318:0:6674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666037.898320:0:6674:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788666037.898323:0:6674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666037.898327:0:6674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666037.898329:0:6674:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788666037.898332:0:6674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788666037.898334:0:6674:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788666037.898359:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:6674:1875552186148352:0@lo:502: 00000100:00100000:3.0:1788666037.898443:0:6674:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666037.898485:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29067a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788666037.898505:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186148224:0@lo:8: 00000100:00100000:3.0:1788666037.898541:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666037.898603:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186148352 00000100:00100000:3.0:1788666037.898609:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186148352 00000100:00100000:3.0:1788666037.898645:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788666037.898653:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+14:6674:x1875552186148352:12345-0@lo:502: 00000100:00100000:3.0:1788666037.898846:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+14:6674:x1875552186148352:12345-0@lo:502: Request processed in 193us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666037.898854:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788666037.898892:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186148224 00000100:00100000:3.0:1788666037.898895:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186148224 00000100:00100000:3.0:1788666037.898914:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788666037.898919:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3274:x1875552186148224:12345-0@lo:8: 00000100:00100000:3.0:1788666037.898960:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3274:x1875552186148224:12345-0@lo:8: Request processed in 40us (419us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788666037.898966:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788666037.898998:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:6674:1875552186148352:0@lo:502: 00000020:01000000:3.0:1788666037.899021:0:6674:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666037.899026:0:6674:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666037.899027:0:6674:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788666037.899031:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:3.0:1788666037.902443:0:3274:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788666037.902455:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab1811e0800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788666037.902463:0:3274:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788666037.902467:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186148224:0@lo:8: 00000020:01000000:3.0:1788666037.902500:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1788666037.902525:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788666037.902535:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c000/0x96bbe788361e982e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9835 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.902556:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c000/0x96bbe788361e982e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9835 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666037.902567:0:5804:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:3.0:1788666037.902570:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff8ab290a54800 from 1 10000000:01000000:3.0:1788666037.902573:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788666037.902625:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff800/0x96bbe788361e9851 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.902634:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff800/0x96bbe788361e9851 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.902645:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff800/0x96bbe788361e9851 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666037.902664:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186148480:0@lo:101: 00000100:00100000:3.0:1788666037.902723:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666037.902762:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29067a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788666037.902781:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186148480 00000100:00100000:3.0:1788666037.902786:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186148480 00000100:00100000:3.0:1788666037.902824:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788666037.902833:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+14:5804:x1875552186148480:12345-0@lo:101: 00010000:00010000:3.0:1788666037.902847:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666037.902859:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2814ff200/0x96bbe788361e9858 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e9851 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.902883:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2814ff200/0x96bbe788361e9858 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e9851 expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.902905:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2814ff200/0x96bbe788361e9858 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9851 expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.902915:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814ff200, rc 0) 00000100:00100000:3.0:1788666037.902953:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+15:5804:x1875552186148480:12345-0@lo:101: Request processed in 121us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666037.902959:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788666037.902999:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186148480:0@lo:101: 00010000:00010000:3.0:1788666037.903012:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff800/0x96bbe788361e9851 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9858 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.903022:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff800/0x96bbe788361e9851 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9858 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666037.903066:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186148608:0@lo:501: 00000100:00100000:3.0:1788666037.903108:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666037.903122:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29067a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788666037.903136:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186148608 00000100:00100000:3.0:1788666037.903139:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186148608 00000100:00100000:3.0:1788666037.903161:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788666037.903167:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+15:5804:x1875552186148608:12345-0@lo:501: 00000100:00100000:3.0:1788666037.903392:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+15:5804:x1875552186148608:12345-0@lo:501: Request processed in 224us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666037.903399:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788666037.903429:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186148608:0@lo:501: 00000100:00100000:3.0:1788666037.903456:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186148736:0@lo:503: 00000100:00100000:3.0:1788666037.903496:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666037.903509:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29067a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788666037.903522:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186148736 00000100:00100000:3.0:1788666037.903525:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186148736 00000100:00100000:3.0:1788666037.903546:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788666037.903552:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+15:5804:x1875552186148736:12345-0@lo:503: 00000100:00100000:3.0:1788666037.903750:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+15:5804:x1875552186148736:12345-0@lo:503: Request processed in 198us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666037.903757:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788666037.903794:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186148736:0@lo:503: 00000100:00100000:3.0:1788666037.909799:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:6677:1875552186148864:0@lo:502: 00000100:00100000:3.0:1788666037.911067:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666037.911126:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29067a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788666037.911543:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186148864 00000100:00100000:0.0:1788666037.911560:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186148864 00000100:00100000:0.0:1788666037.911627:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788666037.911636:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+15:6677:x1875552186148864:12345-0@lo:502: 00000100:00100000:0.0:1788666037.911889:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+15:6677:x1875552186148864:12345-0@lo:502: Request processed in 255us (1990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666037.911897:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788666037.913556:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:6677:1875552186148864:0@lo:502: 00000020:01000000:3.0:1788666037.913638:0:6677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666037.913650:0:6677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666037.913653:0:6677:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788666037.913661:0:6677:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab290a54800 00000020:00000080:3.0:1788666037.913664:0:6677:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788666037.913702:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:6677:1875552186148992:0@lo:502: 00000100:00100000:3.0:1788666037.913784:0:6677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666037.913818:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186148992 00000100:00100000:3.0:1788666037.913824:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186148992 00000100:00100000:3.0:1788666037.913863:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788666037.914876:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+15:6677:x1875552186148992:12345-0@lo:502: 00000100:00100000:3.0:1788666037.915257:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+15:6677:x1875552186148992:12345-0@lo:502: Request processed in 398us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666037.915273:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788666037.915340:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29067a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788666037.915361:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:6677:1875552186148992:0@lo:502: 00000020:01000000:3.0:1788666037.915387:0:6677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666037.915393:0:6677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666037.915395:0:6677:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788666037.915399:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788666037.918899:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788666037.919002:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788666037.919013:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff800/0x96bbe788361e9851 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9858 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666037.919026:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff800/0x96bbe788361e9851 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9858 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666037.919036:0:5804:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788666037.919038:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-sptlrpc-ffff8ab2989a4d40 from 1 10000000:01000000:0.0:1788666037.919041:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788666037.919090:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab280031200/0x96bbe788361e985f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666037.919100:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab280031200/0x96bbe788361e985f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666037.919112:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab280031200/0x96bbe788361e985f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666037.919134:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186149120:0@lo:101: 00000100:00100000:0.0:1788666037.919206:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666037.919251:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab181165480 going to sleep for 11 seconds 00000100:00100000:3.0:1788666037.920018:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186149120 00000100:00100000:3.0:1788666037.920028:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186149120 00000100:00100000:3.0:1788666037.920089:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788666037.920098:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+15:5804:x1875552186149120:12345-0@lo:101: 00010000:00010000:3.0:1788666037.920114:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666037.920130:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2814fe000/0x96bbe788361e9866 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e985f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.920157:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2814fe000/0x96bbe788361e9866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e985f expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.920167:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2814fe000/0x96bbe788361e9866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e985f expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.920176:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814fe000, rc 0) 00000100:00100000:3.0:1788666037.920230:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+16:5804:x1875552186149120:12345-0@lo:101: Request processed in 133us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666037.920237:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788666037.920297:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186149120:0@lo:101: 00010000:00010000:3.0:1788666037.920312:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab280031200/0x96bbe788361e985f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9866 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.920328:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab280031200/0x96bbe788361e985f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9866 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666037.920388:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186149248:0@lo:501: 00000100:00100000:3.0:1788666037.920416:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666037.920451:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29067ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788666037.920464:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186149248 00000100:00100000:3.0:1788666037.920468:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186149248 00000100:00100000:3.0:1788666037.920489:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788666037.920495:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+16:5804:x1875552186149248:12345-0@lo:501: 00000100:00100000:3.0:1788666037.920715:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+16:5804:x1875552186149248:12345-0@lo:501: Request processed in 219us (297us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788666037.920723:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788666037.920751:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186149248:0@lo:501: 10000000:01000000:3.0:1788666037.920772:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788666037.920778:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab280031200/0x96bbe788361e985f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9866 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666037.920785:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab280031200/0x96bbe788361e985f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9866 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788666038.024026:0:6646:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788666038.024046:0:6646:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788666038.024091:0:6646:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788666038.024153:0:6646:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.125@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788666038.024171:0:6646:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788666038.024204:0:6646:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788666038.283239:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666039.308822:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666040.333935:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666041.362808:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666042.379813:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788666043.276302:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788666043.276313:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788666043.276317:0:8:0:(import.c:65:import_set_state_nolock()) ffff8ab1811e0800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788666043.276388:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ab1811e0800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:2.0:1788666043.276412:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab2ae841180 x1875552186149760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788666043.276453:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186149504:0@lo:400: 00000100:00100000:2.0:1788666043.276521:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666043.276600:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788666043.276607:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186149376:0@lo:400: 00000100:00100000:2.0:1788666043.276638:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666043.276670:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186149632:0@lo:400: 00000100:00100000:2.0:1788666043.276694:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666043.276725:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186149760:0@lo:8: 00000100:00100000:2.0:1788666043.276753:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666043.276783:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186149504 00000100:00100000:2.0:1788666043.276790:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186149504 00000100:00100000:2.0:1788666043.276827:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186149632 00000100:00100000:2.0:1788666043.276830:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186149632 00000100:00100000:2.0:1788666043.276855:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788666043.276864:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186149504:12345-0@lo:400: 00000100:00100000:2.0:1788666043.276917:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186149504:12345-0@lo:400: Request processed in 53us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666043.276940:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788666043.276956:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788666043.276962:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186149632:12345-0@lo:400: 00000100:00100000:2.0:1788666043.277157:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae843800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186149632:12345-0@lo:400: Request processed in 194us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666043.277164:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788666043.277183:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186149376 00000100:00100000:2.0:1788666043.277187:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186149376 00000100:00100000:2.0:1788666043.277211:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788666043.277217:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+16:3276:x1875552186149376:12345-0@lo:400: 00000100:00100000:2.0:1788666043.277246:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+16:3276:x1875552186149376:12345-0@lo:400: Request processed in 29us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666043.277252:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788666043.277285:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186149760 00000100:00100000:2.0:1788666043.277289:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186149760 00000100:00100000:2.0:1788666043.277308:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788666043.277313:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3274:x1875552186149760:12345-0@lo:8: 00010000:00080000:2.0:1788666043.277575:0:6651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 149 last 0 00000020:00000080:2.0:1788666043.277624:0:6651:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96bbe788361e986d 00002000:00100000:2.0:1788666043.277665:0:6651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ab2ae321800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788666043.277669:0:6651:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1788666043.277673:0:6651:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788666043.277788:0:6651:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788666043.277932:0:6651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788666043.277956:0:6651:0:(import.c:65:import_set_state_nolock()) ffff8ab2ae321000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788666043.278011:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3274:x1875552186149760:12345-0@lo:8: Request processed in 696us (1257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666043.278024:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788666043.278049:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788666043.278085:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2ae842300 x1875552186149632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666043.278099:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae842300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186149632:0@lo:400: 00010000:00080000:2.0:1788666043.278130:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2ae841180 x1875552186149760/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788666053 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788666043.278141:0:3274:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788666043.278148:0:3274:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788666043.278153:0:3274:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788666043.278155:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab1811e0800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788666043.278166:0:3274:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788666043.278170:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186149760:0@lo:8: 00000100:00100000:2.0:1788666043.278195:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186149376:0@lo:400: 00010000:00080000:2.0:1788666043.278206:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2ae841500 x1875552186149504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666043.278216:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae841500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186149504:0@lo:400: 00000004:00080000:3.0:1788666043.278428:0:6675:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788666043.278660:0:6675:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 149987079322ns, next at 0ns, rc = 0 00000004:00080000:3.0:1788666043.329708:0:6676:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788666043.329746:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6676:1875552186150016:0@lo:7: 00000100:00100000:3.0:1788666043.329823:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666043.329865:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2904953c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788666043.329878:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788666043.329890:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186149888:0@lo:13: 00000100:00100000:3.0:1788666043.329914:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666043.329946:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186150016 00000100:00100000:3.0:1788666043.329953:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186150016 00000100:00100000:3.0:1788666043.330014:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788666043.330023:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6676:x1875552186150016:12345-0@lo:7: 00000004:00080000:0.0:1788666043.333111:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00080000:0.0:1788666043.333648:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788666043.333763:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186149888 00000100:00100000:2.0:1788666043.333774:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186149888 00000100:00100000:2.0:1788666043.333825:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788666043.333835:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3277:x1875552186149888:12345-0@lo:13: 00002000:00000024:2.0:1788666043.333869:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788666043.333963:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3277:x1875552186149888:12345-0@lo:13: Request processed in 130us (4047us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666043.333992:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788666043.334108:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2b46b7b80 x1875552186149888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666043.334131:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186149888:0@lo:13: 00002000:00080000:3.0:1788666043.337440:0:6650:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788666043.337448:0:6650:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788666043.337606:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6676:x1875552186150016:12345-0@lo:7: Request processed in 7578us (7777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666043.337617:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788666043.338756:0:6676:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2b46b5c00 x1875552186150016/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788666059 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666043.338774:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6676:1875552186150016:0@lo:7: 00000004:00080000:0.0:1788666043.338789:0:6676:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788666043.338831:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989ff100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6676:1875552186150144:0@lo:5: 00000100:00100000:0.0:1788666043.338878:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666043.338930:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516780 going to sleep for 11 seconds 00000100:00100000:2.0:1788666043.338987:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186150144 00000100:00100000:2.0:1788666043.338996:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186150144 00000100:00100000:2.0:1788666043.339077:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788666043.339087:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6676:x1875552186150144:12345-0@lo:5: 00002000:00080000:2.0:1788666043.339122:0:6649:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788666043.339126:0:6649:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788666043.339460:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6676:x1875552186150144:12345-0@lo:5: Request processed in 374us (581us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788666043.339468:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788666043.339845:0:6676:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2989ff100 x1875552186150144/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788666059 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666043.339860:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989ff100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6676:1875552186150144:0@lo:5: 00000004:00080000:0.0:1788666043.339869:0:6676:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788666043.339898:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6676:1875552186150272:0@lo:700: 00000100:00100000:0.0:1788666043.339929:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666043.339955:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516780 going to sleep for 11 seconds 00000100:00100000:3.0:1788666043.340032:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186150272 00000100:00100000:3.0:1788666043.340038:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186150272 00000100:00100000:3.0:1788666043.340065:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788666043.340072:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6676:x1875552186150272:12345-0@lo:700: 00000100:00100000:3.0:1788666043.340102:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6657:1875552186150400:0@lo:700: 00000100:00100000:3.0:1788666043.340133:0:6657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666043.340148:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28a9e50c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788666043.340207:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186150400 00000100:00100000:0.0:1788666043.340211:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186150400 00000100:00100000:0.0:1788666043.340246:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788666043.340252:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6657:x1875552186150400:12345-0@lo:700: 00010000:00010000:3.0:1788666043.412285:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:0.0:1788666043.437183:0:5815:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788666043.448213:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6657:x1875552186150400:12345-0@lo:700: Request processed in 107954us (108071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666043.448233:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788666043.451128:0:6657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2b46b5f80 x1875552186150400/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788666059 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666043.451148:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6657:1875552186150400:0@lo:700: 40000000:02000000:0.0:1788666043.451165:0:6657:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1788666043.546645:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6676:x1875552186150272:12345-0@lo:700: Request processed in 206565us (206707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666043.546663:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:1.0:1788666043.546763:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1788666043.546772:0:6678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1788666043.547150:0:6676:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2989fc700 x1875552186150272/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788666059 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666043.547167:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6676:1875552186150272:0@lo:700: 00000004:02000040:2.0:1788666043.588416:0:6676:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1788666043.596020:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae841500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6676:1875552186150528:0@lo:5: 00000100:00100000:2.0:1788666043.596161:0:6676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666043.596265:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab290587a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788666043.596320:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186150528 00000100:00100000:1.0:1788666043.596391:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186150528 00000100:00100000:1.0:1788666043.596502:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788666043.596512:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6676:x1875552186150528:12345-0@lo:5: 00002000:00080000:0.0:1788666043.614214:0:6651:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788666043.614235:0:6651:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1788666043.628853:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae841f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6676:x1875552186150528:12345-0@lo:5: Request processed in 32332us (32750us total) trans 4294967298 rc 0/0 00010000:00080000:2.0:1788666043.628878:0:6676:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2ae841500 x1875552186150528/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788666059 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666043.628880:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788666043.628891:0:6676:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788666043.628905:0:6676:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8ab2ae841500 x1875552186150528/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788666059 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666043.628917:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae841500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6676:1875552186150528:0@lo:5: 00000004:00080000:2.0:1788666043.628932:0:6676:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788666044.437051:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788666045.275751:0:7019:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788666045.460953:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666046.478290:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666047.499033:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666048.395908:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186150784:0@lo:400: 00000100:00100000:2.0:1788666048.397073:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186150656:0@lo:400: 00000100:00100000:2.0:1788666048.405378:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666048.405573:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666048.405710:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b422bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186150912:0@lo:400: 00000100:00100000:1.0:1788666048.405747:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666048.405766:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788666048.405773:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186151040:0@lo:400: 00000100:00100000:1.0:1788666048.405801:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666048.405835:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186150784 00000100:00100000:1.0:1788666048.405845:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186150784 00000100:00100000:1.0:1788666048.405888:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186150912 00000100:00100000:1.0:1788666048.405906:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186150912 00000100:00100000:1.0:1788666048.405937:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788666048.406744:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186150656 00000100:00100000:2.0:1788666048.406750:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186150656 00000100:00100000:2.0:1788666048.406780:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788666048.406788:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+16:3275:x1875552186150656:12345-0@lo:400: 00000100:00100000:2.0:1788666048.406847:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+16:3275:x1875552186150656:12345-0@lo:400: Request processed in 60us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666048.406854:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788666048.406904:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186151168:0@lo:13: 00000100:00100000:2.0:1788666048.406933:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666048.407559:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186150784:12345-0@lo:400: 00000100:00100000:2.0:1788666048.407731:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186150656:0@lo:400: 00000100:00100000:2.0:1788666048.407769:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186151168 00000100:00100000:2.0:1788666048.407774:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186151168 00000100:00100000:2.0:1788666048.407811:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788666048.407818:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3275:x1875552186151168:12345-0@lo:13: 00002000:00000024:2.0:1788666048.407847:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666048.407901:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3275:x1875552186151168:12345-0@lo:13: Request processed in 72us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666048.407908:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788666048.407938:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2ae841180 x1875552186151168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666064 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666048.408131:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788666048.408798:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186150784:12345-0@lo:400: Request processed in 1245us (3223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666048.408807:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788666048.408832:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788666048.408841:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186150912:12345-0@lo:400: 00000100:00100000:1.0:1788666048.408881:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186150912:12345-0@lo:400: Request processed in 42us (3133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666048.408887:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788666048.408918:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788666048.408923:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666048.409043:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788666048.409066:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186151040 00000100:00100000:0.0:1788666048.409072:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186151040 00000100:00100000:0.0:1788666048.409103:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788666048.409111:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b422b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1875552186151040:12345-0@lo:400: 00010000:00080000:1.0:1788666048.409531:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2b4228380 x1875552186150784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666048.409546:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186150784:0@lo:400: 00000100:00100000:0.0:1788666048.409699:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b422b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3277:x1875552186151040:12345-0@lo:400: Request processed in 589us (3895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666048.409707:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788666048.410217:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186151168:0@lo:13: 00010000:00080000:1.0:1788666048.410739:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2b4229c00 x1875552186151040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666048.410750:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186151040:0@lo:400: 00010000:00080000:1.0:1788666048.410771:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2b422bb80 x1875552186150912/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666048.410780:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b422bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186150912:0@lo:400: 00010000:00010000:3.0:1788666048.539399:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788666048.974913:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788666049.548288:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666050.572114:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666051.604202:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666052.623302:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666053.515619:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186151680:0@lo:400: 00000100:00100000:0.0:1788666053.515709:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666053.515764:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788666053.515770:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186151296:0@lo:400: 00000100:00100000:0.0:1788666053.515799:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666053.515842:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186151424:0@lo:400: 00000100:00100000:0.0:1788666053.515870:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666053.515890:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788666053.515896:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186151552:0@lo:400: 00000100:00100000:0.0:1788666053.515917:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666053.515947:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186151296 00000100:00100000:0.0:1788666053.515953:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186151296 00000100:00100000:0.0:1788666053.515995:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788666053.516004:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+16:3275:x1875552186151296:12345-0@lo:400: 00000100:00100000:0.0:1788666053.516052:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+16:3275:x1875552186151296:12345-0@lo:400: Request processed in 49us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666053.516060:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788666053.516092:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186151424 00000100:00100000:0.0:1788666053.516096:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186151424 00000100:00100000:0.0:1788666053.516119:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186151552 00000100:00100000:0.0:1788666053.516122:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186151552 00000100:00100000:0.0:1788666053.516150:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788666053.516242:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186151424:12345-0@lo:400: 00000100:00100000:0.0:1788666053.516349:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186151424:12345-0@lo:400: Request processed in 192us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666053.516355:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788666053.516368:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788666053.516374:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186151552:12345-0@lo:400: 00000100:00100000:0.0:1788666053.516411:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186151552:12345-0@lo:400: Request processed in 38us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666053.516417:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1788666053.516443:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788666053.516474:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2989ff100 x1875552186151552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666053.516489:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186151552:0@lo:400: 00010000:00080000:0.0:1788666053.516500:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2989fc380 x1875552186151424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666053.516508:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186151424:0@lo:400: 00000100:00100000:0.0:1788666053.516534:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186151296:0@lo:400: 00000100:00100000:3.0:1788666053.517145:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186151680 00000100:00100000:3.0:1788666053.517163:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186151680 00000100:00100000:3.0:1788666053.517384:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788666053.517392:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186151680:12345-0@lo:400: 00000100:00100000:3.0:1788666053.517448:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186151680:12345-0@lo:400: Request processed in 57us (1739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666053.517454:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788666053.517915:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2989fc700 x1875552186151680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666069 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666053.517926:0:3275:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788666053.517939:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186151680:0@lo:400: 00000100:00080000:1.0:1788666053.518544:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788666053.521114:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186151808:0@lo:13: 00000100:00100000:2.0:1788666053.521213:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666053.521267:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186151808 00000100:00100000:2.0:1788666053.521275:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186151808 00000100:00100000:2.0:1788666053.521327:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788666053.521335:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186151808:12345-0@lo:13: 00002000:00000024:2.0:1788666053.521370:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666053.521416:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae841500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186151808:12345-0@lo:13: Request processed in 81us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666053.521422:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788666053.521466:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2ae841180 x1875552186151808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666069 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666053.521486:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae841180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186151808:0@lo:13: 00010000:00010000:3.0:1788666053.644424:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666054.669471:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666055.694335:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666056.714803:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788666056.729265:0:7588:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:0.0:1788666056.729270:0:7588:0:(obd_mount.c:924:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788666056.729384:0:7588:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ab2bbf65000 00000020:01000004:0.0:1788666056.729402:0:7588:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788666056.729416:0:7588:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788666056.729444:0:7588:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8ab2c19b3380) 00000020:00000080:0.0:1788666056.729470:0:7588:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788666056.748269:0:7588:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788666056.748717:0:7588:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788666056.768796:0:7588:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788666056.783939:0:7588:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788666056.783974:0:7588:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788666056.785803:0:7588:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788666056.785877:0:7588:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788666056.787521:0:7588:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788666056.787538:0:7588:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788666056.787875:0:7588:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x96bbe788361e987b 00000020:01000004:2.0:1788666056.787885:0:7588:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788666056.787906:0:7588:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.125@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788666056.787909:0:7588:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.201.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788666056.787915:0:7588:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788666056.787939:0:7588:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788666056.787943:0:7588:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.125@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788666056.841344:0:7588:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788666056.841390:0:7588:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.125@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788666056.841395:0:7588:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788666056.841396:0:7588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788666056.841398:0:7588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666056.841399:0:7588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666056.841400:0:7588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666056.841401:0:7588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666056.841403:0:7588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788666056.841405:0:7588:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788666056.841406:0:7588:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788666056.841408:0:7588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666056.841409:0:7588:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788666056.841412:0:7588:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788666056.841415:0:7588:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788666056.841417:0:7588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788666056.841418:0:7588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666056.841424:0:7588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666056.841425:0:7588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666056.841426:0:7588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666056.841427:0:7588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788666056.841428:0:7588:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788666056.841428:0:7588:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788666056.841429:0:7588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666056.841430:0:7588:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788666056.841458:0:7588:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788666056.841476:0:7588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186151936:0@lo:253: 00000100:00100000:3.0:1788666056.841839:0:7588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666056.841971:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186151936 00000100:00100000:2.0:1788666056.841987:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186151936 00000100:00100000:3.0:1788666056.842055:0:7588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516780 going to sleep for 11 seconds 00000100:00100000:2.0:1788666056.844938:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788666056.844963:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+16:7588:x1875552186151936:12345-0@lo:253: 20000000:01000000:2.0:1788666056.845005:0:5801:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788666056.845009:0:5801:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788666056.845014:0:5801:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788666056.845018:0:5801:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1788666056.848902:0:5801:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788666056.849378:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1788666056.849396:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1788666056.849441:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1788666056.849450:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1788666056.849483:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1788666056.849536:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1788666056.850349:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1788666056.850374:0:5801:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.125@tcp 20000000:01000000:3.0:1788666056.850376:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.125@tcp (null) (null) (null) 00000040:00080000:3.0:1788666056.850414:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1788666056.850422:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788666056.850472:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1788666056.850480:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.125@tcp (null) (null) 00000040:00080000:3.0:1788666056.851365:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1788666056.851381:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788666056.851425:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1788666056.851488:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1788666056.856477:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1788666056.856508:0:5801:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.125@tcp 20000000:01000000:3.0:1788666056.856510:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.125@tcp (null) (null) (null) 00000040:00080000:3.0:1788666056.856873:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1788666056.856883:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788666056.856920:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1788666056.856928:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.125@tcp (null) (null) 00000040:00080000:3.0:1788666056.856978:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1788666056.856989:0:5801:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1788666056.857489:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1788666056.857783:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1788666056.857805:0:5801:0:(mgs_llog.c:5251:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788666056.857808:0:5801:0:(mgs_llog.c:4747:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788666056.857812:0:5801:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788666056.857825:0:5801:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788666056.857827:0:5801:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788666056.857871:0:5801:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788666056.857873:0:5801:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788666056.863951:0:7589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788666056.864496:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788666056.864559:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788666056.864802:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788666056.864815:0:5801:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788666056.864819:0:5801:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788666056.869553:0:7590:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1788666056.869784:0:7590:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1788666056.869843:0:7590:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788666056.870466:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788666056.870512:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788666056.870562:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1788666056.870575:0:5801:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788666056.870622:0:5801:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788666056.872494:0:7591:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788666056.872625:0:7591:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788666056.874514:0:7591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788666056.874933:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788666056.874973:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788666056.875046:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788666056.875061:0:5801:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788666056.875064:0:5801:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788666056.877508:0:7592:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1788666056.877805:0:7592:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1788666056.877846:0:7592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1788666056.878239:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788666056.878285:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1788666056.878345:0:5801:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1788666056.878364:0:5801:0:(mgs_llog.c:5251:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788666056.878367:0:5801:0:(mgs_llog.c:4747:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788666056.878378:0:5801:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788666056.878399:0:5801:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9882 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666056.878430:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab283fd5e00/0x96bbe788361e97c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e97be expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666056.878437:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab283fd5600/0x96bbe788361e97ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e97e8 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666056.878444:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab2814fe600/0x96bbe788361e9819 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9812 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666056.878451:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab2a1d7ce00/0x96bbe788361e9835 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e982e expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666056.878457:0:5801:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab2814fe000/0x96bbe788361e9866 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e985f expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666056.878465:0:5801:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9882 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666056.878508:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab2814fe000/0x96bbe788361e9866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e985f expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666056.878523:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab2814fe000/0x96bbe788361e9866 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e985f expref: 16 pid: 5800 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666056.878539:0:5801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1875552186152064:0@lo:104: 00000100:00100000:3.0:1788666056.878661:0:5801:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788666056.878711:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab2a1d7ce00/0x96bbe788361e9835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e982e expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666056.878719:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab2a1d7ce00/0x96bbe788361e9835 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e982e expref: 16 pid: 5802 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666056.878736:0:5801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b5180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1875552186152192:0@lo:104: 00010000:00010000:3.0:1788666056.878777:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab2814fe600/0x96bbe788361e9819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e9812 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666056.878784:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab2814fe600/0x96bbe788361e9819 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e9812 expref: 16 pid: 5801 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666056.878792:0:5801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1875552186152320:0@lo:104: 00010000:00010000:3.0:1788666056.878820:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab283fd5600/0x96bbe788361e97ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e97e8 expref: 16 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666056.878828:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab283fd5600/0x96bbe788361e97ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e97e8 expref: 16 pid: 5800 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666056.878835:0:5801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1875552186152448:0@lo:104: 00010000:00010000:3.0:1788666056.878858:0:5801:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab283fd5e00/0x96bbe788361e97c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e97be expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666056.878866:0:5801:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab283fd5e00/0x96bbe788361e97c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e97be expref: 16 pid: 5801 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666056.878875:0:5801:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b5c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1875552186152576:0@lo:104: 00000100:00100000:3.0:1788666056.878892:0:5801:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516180 going to sleep for 11 seconds 00000100:00100000:2.0:1788666056.879412:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788666056.879436:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666056.879465:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666056.879475:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666056.879483:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666056.879495:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186152064 00000100:00100000:2.0:1788666056.879501:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186152064 00000100:00100000:2.0:1788666056.879532:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186152192 00000100:00100000:2.0:1788666056.879535:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186152192 00000100:00100000:2.0:1788666056.879862:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186152320 00000100:00100000:2.0:1788666056.879865:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186152320 00000100:00100000:2.0:1788666056.879874:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186152448 00000100:00100000:2.0:1788666056.879877:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186152448 00000100:00100000:2.0:1788666056.879885:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186152576 00000100:00100000:2.0:1788666056.879887:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186152576 00000100:00100000:2.0:1788666056.879900:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788666056.879909:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29054d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+7:5801:x1875552186152064:12345-0@lo:104: 00010000:00010000:2.0:1788666056.879938:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab280031200/0x96bbe788361e985f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9866 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.880005:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788666056.880011:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29054d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+7:5801:x1875552186152064:12345-0@lo:104: Request processed in 103us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666056.880019:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788666056.880258:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788666056.880266:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae841180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+6:5801:x1875552186152192:12345-0@lo:104: 00010000:00010000:2.0:1788666056.880280:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c000/0x96bbe788361e982e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9835 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.880328:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788666056.880333:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae841180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+6:5801:x1875552186152192:12345-0@lo:104: Request processed in 69us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666056.880339:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788666056.880352:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788666056.880358:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae842a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+5:5801:x1875552186152320:12345-0@lo:104: 00010000:00010000:2.0:1788666056.880365:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab280030e00/0x96bbe788361e9812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9819 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.880403:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788666056.880408:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae842a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+5:5801:x1875552186152320:12345-0@lo:104: Request processed in 51us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666056.880415:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788666056.880428:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788666056.880434:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+4:5801:x1875552186152448:12345-0@lo:104: 00010000:00010000:2.0:1788666056.880447:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff400/0x96bbe788361e97e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e97ef expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.880476:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788666056.880481:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae840000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+4:5801:x1875552186152448:12345-0@lo:104: Request processed in 48us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666056.880487:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788666056.880498:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788666056.880504:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae840e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+3:5801:x1875552186152576:12345-0@lo:104: 00010000:00010000:2.0:1788666056.880510:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e97be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e97c5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.880535:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788666056.880551:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae840e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+3:5801:x1875552186152576:12345-0@lo:104: Request processed in 36us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666056.880557:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788666056.880609:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788666056.880615:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab280031200/0x96bbe788361e985f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9866 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.880623:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab280031200 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:2.0:1788666056.880627:0:5797:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab280031200/0x96bbe788361e985f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e9866 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.880635:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab280031200/0x96bbe788361e985f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e9866 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666056.881392:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788666056.881537:0:7593:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788666056.881559:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c000/0x96bbe788361e982e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9835 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666056.881568:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7c000 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:1.0:1788666056.881571:0:5796:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c000/0x96bbe788361e982e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e9835 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666056.881593:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c000/0x96bbe788361e982e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e9835 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666056.881601:0:5796:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c000/0x96bbe788361e982e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e9835 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666056.881620:0:5796:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:2.0:1788666056.881835:0:5797:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab280031200/0x96bbe788361e985f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e9866 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666056.881847:0:5797:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788666056.881876:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab280031200/0x96bbe788361e985f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9866 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.881882:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788666056.881903:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab280031200/0x96bbe788361e985f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9866 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.881910:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab280031200/0x96bbe788361e985f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9866 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.881925:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788666056.881929:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff400/0x96bbe788361e97e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e97ef expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.881935:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff400 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:2.0:1788666056.881937:0:5797:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff400/0x96bbe788361e97e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e97ef expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.881943:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff400/0x96bbe788361e97e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e97ef expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788666056.881949:0:5797:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff400/0x96bbe788361e97e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e97ef expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666056.881953:0:5797:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788666056.881965:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff400/0x96bbe788361e97e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e97ef expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.881970:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788666056.881985:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff400/0x96bbe788361e97e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e97ef expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.881991:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff400/0x96bbe788361e97e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e97ef expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.882002:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666056.882005:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e97be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e97c5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.882010:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd5c00 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:2.0:1788666056.882013:0:5797:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e97be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e97c5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.882019:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e97be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e97c5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666056.882431:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c000/0x96bbe788361e982e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9835 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666056.882439:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788666056.882462:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c000/0x96bbe788361e982e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9835 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666056.882469:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c000/0x96bbe788361e982e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9835 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666056.882481:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666056.882483:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666056.882485:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666056.882805:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666056.882811:0:7593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab280030e00/0x96bbe788361e9812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9819 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666056.882818:0:7593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab280030e00 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:1.0:1788666056.882821:0:7593:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab280030e00/0x96bbe788361e9812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e9819 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666056.882828:0:7593:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab280030e00/0x96bbe788361e9812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e9819 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666056.882835:0:7593:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab280030e00/0x96bbe788361e9812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e9819 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666056.882841:0:7593:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788666056.882865:0:7593:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab280030e00/0x96bbe788361e9812 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9819 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666056.882870:0:7593:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788666056.882876:0:7593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab280030e00/0x96bbe788361e9812 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9819 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666056.882882:0:7593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab280030e00/0x96bbe788361e9812 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9819 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666056.882894:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666056.882896:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666056.882897:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666056.882902:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666056.882904:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1788666056.883254:0:5797:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e97be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e97c5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666056.883260:0:5797:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788666056.883440:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e97be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e97c5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.883447:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788666056.883451:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e97be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e97c5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.883458:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e97be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e97c5 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.883472:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666056.883479:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666056.883481:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666056.883500:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186152704:0@lo:103: 00000100:00100000:2.0:1788666056.883605:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666056.883657:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186153216:0@lo:103: 00000100:00100000:2.0:1788666056.883677:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666056.883697:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666056.883703:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186152832:0@lo:103: 00000100:00100000:2.0:1788666056.883734:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666056.883774:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b422bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186152960:0@lo:103: 00000100:00100000:2.0:1788666056.883796:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666056.883809:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788666056.883814:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186153088:0@lo:103: 00000100:00100000:2.0:1788666056.883849:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666056.883882:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186152704 00000100:00100000:2.0:1788666056.883889:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186152704 00010000:00010000:2.0:1788666056.883915:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab2814fe000/0x96bbe788361e9866 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e985f expref: 17 pid: 5800 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666056.883933:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186153216 00000100:00100000:2.0:1788666056.883935:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186153216 00010000:00010000:2.0:1788666056.883944:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab283fd5e00/0x96bbe788361e97c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e97be expref: 18 pid: 5801 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666056.883952:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186152832 00000100:00100000:2.0:1788666056.883955:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186152832 00010000:00010000:2.0:1788666056.883962:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab283fd5600/0x96bbe788361e97ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e97e8 expref: 19 pid: 5800 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666056.883970:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186152960 00000100:00100000:2.0:1788666056.883977:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186152960 00010000:00010000:2.0:1788666056.883990:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab2a1d7ce00/0x96bbe788361e9835 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e982e expref: 20 pid: 5802 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666056.884000:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186153088 00000100:00100000:2.0:1788666056.884002:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186153088 00010000:00010000:2.0:1788666056.884011:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab2814fe600/0x96bbe788361e9819 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9812 expref: 21 pid: 5801 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666056.884022:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788666056.884030:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae840380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+21:3277:x1875552186152704:12345-0@lo:103: 00010000:00010000:2.0:1788666056.884042:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666056.884047:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab2814fe000/0x96bbe788361e9866 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e985f expref: 21 pid: 5800 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.884057:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab2814fe000/0x96bbe788361e9866 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e985f expref: 21 pid: 5800 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.884072:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666056.884118:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae840380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+21:3277:x1875552186152704:12345-0@lo:103: Request processed in 88us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666056.884126:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788666056.884152:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788666056.884159:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae843b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+20:3277:x1875552186153216:12345-0@lo:103: 00010000:00010000:2.0:1788666056.884166:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666056.884170:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab283fd5e00/0x96bbe788361e97c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e97be expref: 20 pid: 5801 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.884179:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab283fd5e00/0x96bbe788361e97c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e97be expref: 20 pid: 5801 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.884199:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666056.884222:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae843b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+20:3277:x1875552186153216:12345-0@lo:103: Request processed in 63us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666056.884229:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788666056.884241:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788666056.884247:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae840700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+19:3277:x1875552186152832:12345-0@lo:103: 00010000:00010000:2.0:1788666056.884254:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666056.884259:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab283fd5600/0x96bbe788361e97ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e97e8 expref: 19 pid: 5800 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.884266:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab283fd5600/0x96bbe788361e97ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e97e8 expref: 19 pid: 5800 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.884274:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666056.884292:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae840700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+19:3277:x1875552186152832:12345-0@lo:103: Request processed in 47us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666056.884298:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788666056.884307:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788666056.884313:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+18:3275:x1875552186152960:12345-0@lo:103: 00010000:00010000:2.0:1788666056.884319:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666056.884323:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab2a1d7ce00/0x96bbe788361e9835 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e982e expref: 18 pid: 5802 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.884331:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab2a1d7ce00/0x96bbe788361e9835 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e982e expref: 18 pid: 5802 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.884339:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666056.884360:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae841880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+18:3275:x1875552186152960:12345-0@lo:103: Request processed in 47us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666056.884371:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788666056.884383:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788666056.884389:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+17:3275:x1875552186153088:12345-0@lo:103: 00010000:00010000:2.0:1788666056.884396:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666056.884401:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab2814fe600/0x96bbe788361e9819 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9812 expref: 17 pid: 5801 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.884410:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab2814fe600/0x96bbe788361e9819 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e9812 expref: 17 pid: 5801 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.884421:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9882 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.884429:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9882 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.884442:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9882 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.884449:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9882 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.884455:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9882 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.884462:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9882 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.884473:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff000 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666056.884476:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9882 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.884490:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9882 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.884498:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9882 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.884507:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666056.884530:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+17:3275:x1875552186153088:12345-0@lo:103: Request processed in 141us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666056.884536:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788666056.884598:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186152832:0@lo:103: 00000100:00100000:2.0:1788666056.885502:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae840a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186152704:0@lo:103: 00000100:00100000:2.0:1788666056.885513:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186153216:0@lo:103: 00000100:00100000:2.0:1788666056.885560:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186153088:0@lo:103: 00000100:00100000:2.0:1788666056.885567:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b422bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186152960:0@lo:103: 00010000:00010000:2.0:1788666056.885628:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2814fe000/0x96bbe788361e9866 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e985f expref: 16 pid: 5800 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666056.885872:0:5801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1875552186152064:0@lo:104: 00010000:00010000:2.0:1788666056.885888:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2a1d7ce00/0x96bbe788361e9835 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e982e expref: 15 pid: 5802 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666056.885897:0:5801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b5180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1875552186152192:0@lo:104: 00010000:00010000:2.0:1788666056.885906:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2814fe600/0x96bbe788361e9819 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e9812 expref: 14 pid: 5801 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666056.885930:0:5801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b6d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1875552186152320:0@lo:104: 00010000:00010000:2.0:1788666056.885944:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab283fd5600/0x96bbe788361e97ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e97e8 expref: 13 pid: 5800 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666056.885952:0:5801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1875552186152448:0@lo:104: 00010000:00010000:2.0:1788666056.885962:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab283fd5e00/0x96bbe788361e97c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e97be expref: 12 pid: 5801 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666056.885969:0:5801:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b5c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5801:1875552186152576:0@lo:104: 00010000:00010000:2.0:1788666056.885990:0:5801:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9882 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.886000:0:5801:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9882 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.886007:0:5801:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9882 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.886013:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9882 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788666056.886027:0:5801:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788666056.974914:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+11:7588:x1875552186151936:12345-0@lo:253: Request processed in 129954us (133065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666056.974930:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788666056.975023:0:7588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186151936:0@lo:253: 10000000:01000000:0.0:1788666056.975039:0:7588:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788666056.975043:0:7588:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788666056.975045:0:7588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788666056.975046:0:7588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788666056.975061:0:7588:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788666056.975062:0:7588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788666056.975064:0:7588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788666056.975066:0:7588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788666056.975067:0:7588:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788666056.975069:0:7588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788666056.975070:0:7588:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788666056.975091:0:7588:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab2bbf65000 from lustre-OST0001 10000000:01000000:0.0:1788666056.975251:0:7588:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788666056.975254:0:7588:0:(mgc_request.c:327:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788666056.975263:0:7588:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ab2989a4d40 local copy 10000000:01000000:0.0:1788666056.975267:0:7588:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788666056.975304:0:7588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e9889 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666056.975315:0:7588:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e9889 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666056.975325:0:7588:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e9889 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666056.975342:0:7588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186153344:0@lo:101: 00000100:00100000:0.0:1788666056.975377:0:7588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666056.975478:0:7588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2b4a2a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788666056.975608:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186153344 00000100:00100000:2.0:1788666056.975615:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186153344 00000100:00100000:2.0:1788666056.975662:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788666056.975672:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+11:7588:x1875552186153344:12345-0@lo:101: 00010000:00010000:2.0:1788666056.975687:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666056.975701:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab283fd5e00/0x96bbe788361e9890 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e9889 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.975735:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab283fd5e00/0x96bbe788361e9890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e9889 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.975756:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab283fd5e00/0x96bbe788361e9890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9889 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.975765:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd5e00, rc 0) 00000100:00100000:2.0:1788666056.975809:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+12:7588:x1875552186153344:12345-0@lo:101: Request processed in 140us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666056.975816:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788666056.975954:0:7588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186153344:0@lo:101: 00010000:00010000:3.0:1788666056.975980:0:7588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e9889 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x96bbe788361e9890 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666056.975990:0:7588:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e9889 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x96bbe788361e9890 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666056.976091:0:7588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186153472:0@lo:501: 00000100:00100000:3.0:1788666056.976143:0:7588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666056.976218:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186153472 00000100:00100000:0.0:1788666056.976223:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186153472 00000100:00100000:0.0:1788666056.976251:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788666056.976258:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+12:7588:x1875552186153472:12345-0@lo:501: 00000100:00100000:0.0:1788666056.976443:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+12:7588:x1875552186153472:12345-0@lo:501: Request processed in 185us (309us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788666056.976450:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788666056.977031:0:7588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516180 going to sleep for 11 seconds 00000100:00100000:3.0:1788666056.977053:0:7588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186153472:0@lo:501: 10000000:01000000:3.0:1788666056.977071:0:7588:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788666056.977219:0:7588:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788666056.977227:0:7588:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e9889 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x96bbe788361e9890 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666056.977236:0:7588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e9889 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x96bbe788361e9890 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666056.977243:0:7588:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e9889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x96bbe788361e9890 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666056.977303:0:7588:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788666056.977330:0:7588:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab2bbf65000 10000000:01000000:3.0:1788666056.977335:0:7588:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788666056.977341:0:7588:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788666056.977343:0:7588:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788666056.977348:0:7588:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788666056.977351:0:7588:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788666056.977385:0:7588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9897 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666056.977393:0:7588:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9897 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666056.977401:0:7588:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9897 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666056.977416:0:7588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186153600:0@lo:101: 00000100:00100000:3.0:1788666056.977456:0:7588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666056.977488:0:7588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788666056.978048:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186153600 00000100:00100000:0.0:1788666056.978068:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186153600 00000100:00100000:0.0:1788666056.978183:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788666056.978194:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+12:7588:x1875552186153600:12345-0@lo:101: 00010000:00010000:0.0:1788666056.978208:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666056.978223:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab280030400/0x96bbe788361e989e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e9897 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666056.978246:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab280030400/0x96bbe788361e989e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e9897 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666056.978256:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab280030400/0x96bbe788361e989e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9897 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666056.978265:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab280030400, rc 0) 00000100:00100000:0.0:1788666056.978321:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+13:7588:x1875552186153600:12345-0@lo:101: Request processed in 128us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666056.978328:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788666056.978407:0:7588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186153600:0@lo:101: 00010000:00010000:3.0:1788666056.978422:0:7588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9897 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e989e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666056.978432:0:7588:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9897 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e989e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666056.978521:0:7588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186153728:0@lo:501: 00000100:00100000:3.0:1788666056.978567:0:7588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788666056.978827:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666056.978835:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e9889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x96bbe788361e9890 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666056.978843:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab280030000 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:1.0:1788666056.978847:0:5796:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e9889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x96bbe788361e9890 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666056.978856:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e9889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x96bbe788361e9890 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666056.978863:0:5796:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e9889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x96bbe788361e9890 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666056.978869:0:5796:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788666056.978890:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e9889 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x96bbe788361e9890 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666056.978911:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788666056.978933:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e9889 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x96bbe788361e9890 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666056.978941:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e9889 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x96bbe788361e9890 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666056.978955:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666056.978957:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666056.978958:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666056.979330:0:7588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788666056.979430:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186153728 00000100:00100000:2.0:1788666056.979437:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186153728 00000100:00100000:2.0:1788666056.979470:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788666056.979478:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+13:7588:x1875552186153728:12345-0@lo:501: 00000100:00100000:2.0:1788666056.979807:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+13:7588:x1875552186153728:12345-0@lo:501: Request processed in 329us (1238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666056.979814:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788666056.979848:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186153856:0@lo:103: 00000100:00100000:2.0:1788666056.979875:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666056.979908:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186153856 00000100:00100000:2.0:1788666056.979911:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186153856 00000100:00100000:2.0:1788666056.979936:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788666056.979941:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+13:3278:x1875552186153856:12345-0@lo:103: 00010000:00010000:2.0:1788666056.979950:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666056.979965:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab283fd5e00/0x96bbe788361e9890 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96bbe788361e9889 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666056.979987:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666056.980012:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+12:3278:x1875552186153856:12345-0@lo:103: Request processed in 70us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666056.980018:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788666056.980052:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186153856:0@lo:103: 00000100:00100000:3.0:1788666056.980375:0:7588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186153728:0@lo:501: 00000100:00100000:3.0:1788666056.980412:0:7588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186153984:0@lo:503: 00000100:00100000:3.0:1788666056.980454:0:7588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666056.980483:0:7588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788666056.980820:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186153984 00000100:00100000:2.0:1788666056.980826:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186153984 00000100:00100000:2.0:1788666056.980851:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788666056.980858:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+12:7588:x1875552186153984:12345-0@lo:503: 00000100:00100000:2.0:1788666056.981032:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+12:7588:x1875552186153984:12345-0@lo:503: Request processed in 174us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666056.981039:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788666056.981145:0:7588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186153984:0@lo:503: 00000040:00080000:3.0:1788666056.981418:0:7588:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788666056.981498:0:7588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186154112:0@lo:502: 00000100:00100000:3.0:1788666056.981554:0:7588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666056.981612:0:7588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788666056.981932:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186154112 00000100:00100000:2.0:1788666056.981938:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186154112 00000100:00100000:2.0:1788666056.981962:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788666056.981970:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+12:7588:x1875552186154112:12345-0@lo:502: 00000100:00100000:2.0:1788666056.982161:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+12:7588:x1875552186154112:12345-0@lo:502: Request processed in 191us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666056.982168:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788666056.982354:0:7588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186154112:0@lo:502: 00000040:00080000:3.0:1788666056.982681:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788666056.982728:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788666056.982772:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788666056.982820:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788666056.982859:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788666056.982893:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788666056.982922:0:7588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186154240:0@lo:502: 00000100:00100000:3.0:1788666056.982970:0:7588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666056.983001:0:7588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788666056.983422:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186154240 00000100:00100000:2.0:1788666056.983429:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186154240 00000100:00100000:2.0:1788666056.983460:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788666056.983466:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298878850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+12:7588:x1875552186154240:12345-0@lo:502: 00000100:00100000:2.0:1788666056.983678:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298878850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+12:7588:x1875552186154240:12345-0@lo:502: Request processed in 211us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666056.983694:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788666056.983879:0:7588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186154240:0@lo:502: 00000040:00080000:3.0:1788666056.983988:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788666056.984001:0:7588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1788666056.985049:0:7597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788666056.985061:0:7597:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788666056.985068:0:7597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666056.985071:0:7597:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788666056.985077:0:7597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788666056.985232:0:7597:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8ab2b44e3380) 00000020:00000080:3.0:1788666056.985256:0:7597:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788666056.985263:0:7597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788666056.985327:0:7597:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab2bbf65000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788666056.985335:0:7597:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788666056.985341:0:7597:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x96bbe788361e98ac 00010000:00010000:3.0:1788666056.994296:0:7597:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1788666056.994927:0:7597:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788666056.997515:0:7597:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788666056.998047:0:7597:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788666057.003129:0:7597:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788666057.003845:0:7597:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788666057.006075:0:7597:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788666057.006088:0:7597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788666057.006222:0:7597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666057.006225:0:7597:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788666057.006231:0:7597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788666057.006236:0:7597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666057.006237:0:7597:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788666057.006241:0:7597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788666057.006243:0:7597:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788666057.006301:0:7597:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788666057.006304:0:7597:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666057.006306:0:7597:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788666057.006309:0:7597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788666057.006463:0:7588:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788666057.006492:0:7588:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788666057.006519:0:7588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9897 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e989e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666057.006533:0:7588:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e989e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666057.006550:0:7588:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff8ab2bbf65000 from 1 10000000:01000000:3.0:1788666057.006554:0:7588:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788666057.006620:0:7588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe200/0x96bbe788361e98b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666057.006629:0:7588:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe200/0x96bbe788361e98b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666057.006761:0:7588:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe200/0x96bbe788361e98b3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666057.006788:0:7588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186154368:0@lo:101: 00000100:00100000:3.0:1788666057.006861:0:7588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666057.006915:0:7588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788666057.007026:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186154368 00000100:00100000:2.0:1788666057.007034:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186154368 00000100:00100000:2.0:1788666057.007123:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788666057.007198:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+12:7588:x1875552186154368:12345-0@lo:101: 00010000:00010000:2.0:1788666057.007214:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666057.007227:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab283fd5e00/0x96bbe788361e98ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e98b3 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666057.007252:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab283fd5e00/0x96bbe788361e98ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e98b3 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666057.007262:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab283fd5e00/0x96bbe788361e98ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e98b3 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666057.007272:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd5e00, rc 0) 00000100:00100000:2.0:1788666057.007321:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+13:7588:x1875552186154368:12345-0@lo:101: Request processed in 189us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666057.007342:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788666057.007878:0:7588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186154368:0@lo:101: 00010000:00010000:3.0:1788666057.007900:0:7588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe200/0x96bbe788361e98b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e98ba expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666057.007911:0:7588:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe200/0x96bbe788361e98b3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e98ba expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666057.008050:0:7588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186154496:0@lo:501: 00000100:00100000:3.0:1788666057.008088:0:7588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666057.016218:0:7588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788666057.016426:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186154496 00000100:00100000:0.0:1788666057.016436:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186154496 00000100:00100000:0.0:1788666057.016482:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788666057.016493:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+13:7588:x1875552186154496:12345-0@lo:501: 00000100:00100000:0.0:1788666057.016840:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+13:7588:x1875552186154496:12345-0@lo:501: Request processed in 348us (8750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666057.016848:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788666057.017264:0:7588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186154496:0@lo:501: 00000100:00100000:3.0:1788666057.017314:0:7588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186154624:0@lo:503: 00000100:00100000:3.0:1788666057.017367:0:7588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666057.017389:0:7588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788666057.017440:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186154624 00000100:00100000:0.0:1788666057.017446:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186154624 00000100:00100000:0.0:1788666057.017468:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788666057.017475:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+13:7588:x1875552186154624:12345-0@lo:503: 00000100:00100000:0.0:1788666057.018006:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+13:7588:x1875552186154624:12345-0@lo:503: Request processed in 530us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666057.018023:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788666057.018313:0:7588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186154624:0@lo:503: 00000040:00080000:3.0:1788666057.018630:0:7588:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788666057.018829:0:7588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186154752:0@lo:502: 00000100:00100000:3.0:1788666057.018929:0:7588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666057.018956:0:7588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788666057.019403:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186154752 00000100:00100000:0.0:1788666057.019409:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186154752 00000100:00100000:0.0:1788666057.019962:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788666057.019978:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+13:7588:x1875552186154752:12345-0@lo:502: 00000100:00100000:0.0:1788666057.020256:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+13:7588:x1875552186154752:12345-0@lo:502: Request processed in 282us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666057.020264:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788666057.020593:0:7588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186154752:0@lo:502: 00000040:00080000:3.0:1788666057.020896:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788666057.020953:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788666057.020988:0:7588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186154880:0@lo:502: 00000100:00100000:3.0:1788666057.021035:0:7588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666057.021064:0:7588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788666057.021815:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186154880 00000100:00100000:0.0:1788666057.021824:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186154880 00000100:00100000:0.0:1788666057.021888:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788666057.021897:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+13:7588:x1875552186154880:12345-0@lo:502: 00000100:00100000:0.0:1788666057.022411:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+13:7588:x1875552186154880:12345-0@lo:502: Request processed in 513us (1373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666057.022419:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788666057.022626:0:7588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186154880:0@lo:502: 00000040:00080000:3.0:1788666057.023032:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788666057.023050:0:7588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788666057.026080:0:7601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788666057.026104:0:7601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666057.026107:0:7601:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788666057.026115:0:7601:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab2bbf65000 00000020:00000080:0.0:1788666057.026117:0:7601:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788666057.026737:0:7601:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788666057.026756:0:7601:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666057.026758:0:7601:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788666057.026762:0:7601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788666057.027791:0:7588:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788666057.027819:0:7588:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788666057.027839:0:7588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe200/0x96bbe788361e98b3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e98ba expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666057.027871:0:7588:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe200/0x96bbe788361e98b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e98ba expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666057.027919:0:7588:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788666057.027923:0:7588:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff8ab2bbf65000 10000000:01000000:3.0:1788666057.027926:0:7588:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab2bbf65000 10000000:01000000:3.0:1788666057.027930:0:7588:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788666057.027935:0:7588:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff8ab2bbf65000 from 1 10000000:01000000:3.0:1788666057.027938:0:7588:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788666057.027975:0:7588:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe800/0x96bbe788361e98c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666057.027983:0:7588:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe800/0x96bbe788361e98c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666057.027994:0:7588:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe800/0x96bbe788361e98c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666057.028016:0:7588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186155008:0@lo:101: 00000100:00100000:3.0:1788666057.028082:0:7588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666057.028352:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186155008 00000100:00100000:0.0:1788666057.028360:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186155008 00000100:00100000:3.0:1788666057.029261:0:7588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516240 going to sleep for 11 seconds 00000100:00100000:0.0:1788666057.040003:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788666057.040027:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+13:7588:x1875552186155008:12345-0@lo:101: 00010000:00010000:0.0:1788666057.040059:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666057.040080:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab280031400/0x96bbe788361e98c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e98c1 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666057.040121:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab280031400/0x96bbe788361e98c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e98c1 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666057.040134:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab280031400/0x96bbe788361e98c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e98c1 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666057.040145:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab280031400, rc 0) 00000100:00100000:0.0:1788666057.040250:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+14:7588:x1875552186155008:12345-0@lo:101: Request processed in 233us (12166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666057.040258:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788666057.040366:0:7588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186155008:0@lo:101: 00010000:00010000:3.0:1788666057.040390:0:7588:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe800/0x96bbe788361e98c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e98c8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666057.040401:0:7588:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe800/0x96bbe788361e98c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e98c8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666057.040537:0:7588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186155136:0@lo:501: 00000100:00100000:3.0:1788666057.040614:0:7588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666057.042719:0:7588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516240 going to sleep for 11 seconds 00000100:00100000:1.0:1788666057.044608:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186155136 00000100:00100000:1.0:1788666057.044622:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186155136 00000100:00100000:1.0:1788666057.044755:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788666057.044767:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+14:7588:x1875552186155136:12345-0@lo:501: 00000100:00100000:1.0:1788666057.045305:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+14:7588:x1875552186155136:12345-0@lo:501: Request processed in 540us (4726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666057.045314:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788666057.045514:0:7588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186155136:0@lo:501: 00000100:00100000:2.0:1788666057.045847:0:7588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186155264:0@lo:503: 00000100:00100000:2.0:1788666057.046008:0:7588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666057.046061:0:7588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b7900 going to sleep for 11 seconds 00000100:00100000:3.0:1788666057.046132:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186155264 00000100:00100000:3.0:1788666057.046138:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186155264 00000100:00100000:1.0:1788666057.046245:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788666057.046255:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298878450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+14:7588:x1875552186155264:12345-0@lo:503: 00000100:00100000:1.0:1788666057.046429:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298878450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+14:7588:x1875552186155264:12345-0@lo:503: Request processed in 176us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666057.046439:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788666057.046457:0:7588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186155264:0@lo:503: 00000040:00080000:2.0:1788666057.046900:0:7588:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788666057.046971:0:7588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186155392:0@lo:502: 00000100:00100000:2.0:1788666057.047014:0:7588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666057.047044:0:7588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788666057.047056:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186155392 00000100:00100000:1.0:1788666057.047063:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186155392 00000100:00100000:1.0:1788666057.047188:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788666057.047196:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+14:7588:x1875552186155392:12345-0@lo:502: 00000100:00100000:1.0:1788666057.047384:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+14:7588:x1875552186155392:12345-0@lo:502: Request processed in 189us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666057.047398:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788666057.047421:0:7588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186155392:0@lo:502: 00000040:00080000:3.0:1788666057.048200:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788666057.048283:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788666057.048324:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788666057.048375:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788666057.048413:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788666057.048483:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788666057.048521:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788666057.048571:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788666057.049186:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788666057.049235:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788666057.049270:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788666057.049338:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788666057.049375:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788666057.049409:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788666057.049457:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788666057.049492:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788666057.049527:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788666057.050293:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788666057.050348:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788666057.050376:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788666057.050419:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788666057.050448:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788666057.050480:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788666057.050528:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788666057.050620:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788666057.050954:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788666057.051045:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788666057.051174:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788666057.051211:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788666057.051254:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788666057.051287:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788666057.051318:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788666057.051349:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788666057.051394:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788666057.051425:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788666057.051465:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788666057.051499:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788666057.051565:0:7588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186155520:0@lo:502: 00000100:00100000:3.0:1788666057.052053:0:7588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666057.052195:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186155520 00000100:00100000:1.0:1788666057.052204:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186155520 00000100:00100000:1.0:1788666057.052258:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788666057.052268:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298878c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+14:7588:x1875552186155520:12345-0@lo:502: 00000100:00100000:1.0:1788666057.052486:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298878c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+14:7588:x1875552186155520:12345-0@lo:502: Request processed in 219us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666057.052494:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788666057.052563:0:7588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516480 going to sleep for 11 seconds 00000100:00100000:3.0:1788666057.052612:0:7588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186155520:0@lo:502: 00000040:00080000:3.0:1788666057.052776:0:7588:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788666057.052788:0:7588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1788666057.055845:0:7602:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1788666057.055947:0:7602:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8ab2b4824d40) 00000020:00000080:1.0:1788666057.055971:0:7602:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1788666057.056067:0:7602:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab2bbf65000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788666057.056071:0:7602:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab2bbf65000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1788666057.056074:0:7602:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab2bbf65000 3 00010000:00080000:1.0:1788666057.056165:0:7602:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab2bbe64800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.125@tcp at head 00010000:00010000:1.0:1788666057.059391:0:7602:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788666057.060220:0:7602:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788666057.060260:0:7602:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788666057.060271:0:7602:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x96bbe788361e98d6 00000100:00080000:1.0:1788666057.060281:0:7602:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788666057.060287:0:7602:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ab2bbe64800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:1.0:1788666057.060322:0:7602:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab2b4229f80 x1875552186155648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788666057.060345:0:7602:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788666057.060386:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3274:1875552186155648:0@lo:38: 00000100:00100000:2.0:1788666057.060460:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788666057.063036:0:7602:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1788666057.063249:0:7588:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788666057.063276:0:7588:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788666057.063301:0:7588:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe800/0x96bbe788361e98c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e98c8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666057.063313:0:7588:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe800/0x96bbe788361e98c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e98c8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788666057.063361:0:7588:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788666057.063364:0:7588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788666057.063366:0:7588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666057.063368:0:7588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666057.063369:0:7588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666057.063371:0:7588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666057.063377:0:7588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788666057.063379:0:7588:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788666057.063380:0:7588:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788666057.063382:0:7588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666057.063383:0:7588:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788666057.063388:0:7588:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788666057.063390:0:7588:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788666057.063392:0:7588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788666057.063393:0:7588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666057.063394:0:7588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666057.063395:0:7588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666057.063396:0:7588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666057.063397:0:7588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788666057.063398:0:7588:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788666057.063399:0:7588:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788666057.063400:0:7588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666057.063400:0:7588:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788666057.063431:0:7588:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788666057.063451:0:7588:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186155776:0@lo:253: 00000100:00100000:3.0:1788666057.063528:0:7588:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666057.063882:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186155904:0@lo:400: 00000100:00100000:0.0:1788666057.063914:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186155648 00000100:00100000:2.0:1788666057.063922:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666057.063923:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186155648 00000100:00100000:0.0:1788666057.063957:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186155904 00000100:00100000:2.0:1788666057.063959:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788666057.063961:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186155904 00000100:00100000:2.0:1788666057.063967:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3275:1875552186156032:0@lo:400: 00000100:00100000:2.0:1788666057.063995:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666057.063999:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788666057.064010:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186155904:12345-0@lo:400: 00000100:00100000:0.0:1788666057.064066:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186155904:12345-0@lo:400: Request processed in 59us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666057.064074:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788666057.064100:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2989fc380 x1875552186155904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666057.064114:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186155904:0@lo:400: 00000100:00100000:0.0:1788666057.064247:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186156032 00000100:00100000:0.0:1788666057.064253:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186156032 00000100:00100000:0.0:1788666057.064292:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788666057.064299:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1875552186156032:12345-0@lo:400: 00000100:00100000:0.0:1788666057.064337:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1875552186156032:12345-0@lo:400: Request processed in 39us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666057.064354:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788666057.064364:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2989ff100 x1875552186156032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666057.064373:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788666057.064378:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3274:x1875552186155648:12345-0@lo:38: 00000100:00100000:2.0:1788666057.064395:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3275:1875552186156032:0@lo:400: 00010000:00080000:0.0:1788666057.064403:0:5809:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 163 last 0 00000020:00000080:0.0:1788666057.064440:0:5809:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x96bbe788361e98dd 00000004:00100000:0.0:1788666057.064456:0:5809:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788666057.064487:0:5809:0:(import.c:65:import_set_state_nolock()) ffff8ab2865e4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788666057.064531:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1875552186155648:12345-0@lo:38: Request processed in 151us (4070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666057.064550:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788666057.064559:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2b4229f80 x1875552186155648/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788666067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666057.064569:0:3274:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00100000:0.0:1788666057.064574:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186156160:0@lo:400: 00000100:00080000:2.0:1788666057.064577:0:3274:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788666057.064607:0:3274:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788666057.064613:0:3274:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788666057.064616:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab2bbe64800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788666057.064631:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788666057.064733:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666057.064758:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3274:1875552186155648:0@lo:38: 00000100:00100000:2.0:1788666057.064858:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186156160 00000100:00100000:2.0:1788666057.064862:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186156160 00000100:00100000:2.0:1788666057.064922:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788666057.064930:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186156160:12345-0@lo:400: 00000100:00100000:2.0:1788666057.064967:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186156160:12345-0@lo:400: Request processed in 37us (335us total) trans 0 rc 0/0 00000100:00080000:1.0:1788666057.064967:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788666057.064974:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788666057.065031:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2989fe680 x1875552186156160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666073 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666057.065041:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186156160:0@lo:400: 00000100:00100000:3.0:1788666057.065187:0:7588:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788666057.065207:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186155776 00000100:00100000:3.0:1788666057.065211:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186155776 00000100:00100000:3.0:1788666057.065276:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788666057.065284:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+14:7588:x1875552186155776:12345-0@lo:253: 20000000:01000000:3.0:1788666057.065317:0:5800:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788666057.065331:0:5800:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788666057.065701:0:7604:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fe680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7604:1875552186156288:0@lo:901: 00000100:00100000:0.0:1788666057.065754:0:7604:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666057.065774:0:7604:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2b4a2a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788666057.066331:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186156288 00000100:00100000:3.0:1788666057.066337:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186156288 00000100:00100000:3.0:1788666057.066381:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788666057.066389:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7604:x1875552186156288:12345-0@lo:901: 00000100:00100000:3.0:1788666057.066781:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7604:x1875552186156288:12345-0@lo:901: Request processed in 392us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666057.066790:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788666057.066831:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788666057.070904:0:7604:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2989fe680 x1875552186156288/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788666073 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666057.070924:0:7604:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fe680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7604:1875552186156288:0@lo:901: 20000000:01000000:2.0:1788666057.093221:0:5800:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788666057.093244:0:5800:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788666057.093310:0:5824:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788666057.093316:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788666057.093340:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab280030000/0x96bbe788361e98e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666057.093372:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab2a1d7c400/0x96bbe788361e9827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9820 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666057.093381:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab280030000/0x96bbe788361e98e4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666057.093421:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab2a1d7c400/0x96bbe788361e9827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e9820 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666057.093436:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab2a1d7c400/0x96bbe788361e9827 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e9820 expref: 14 pid: 5802 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666057.093453:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fe680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5824:1875552186156416:0@lo:104: 00000100:00100000:0.0:1788666057.093524:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666057.093620:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2b4a2a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666057.095344:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186156416 00000100:00100000:2.0:1788666057.095359:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186156416 00000100:00100000:2.0:1788666057.095422:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788666057.095432:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+3:5824:x1875552186156416:12345-0@lo:104: 00010000:00010000:2.0:1788666057.095450:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e9820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9827 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666057.095764:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788666057.095784:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+3:5824:x1875552186156416:12345-0@lo:104: Request processed in 354us (2258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666057.095792:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788666057.096900:0:7593:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666057.096911:0:7593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e9820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9827 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666057.096922:0:7593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff600 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:0.0:1788666057.096927:0:7593:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e9820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e9827 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666057.096938:0:7593:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e9820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e9827 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788666057.096946:0:7593:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e9820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e9827 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666057.096967:0:7593:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788666057.097011:0:7593:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e9820 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9827 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666057.097018:0:7593:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788666057.097037:0:7593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e9820 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9827 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666057.097044:0:7593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e9820 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9827 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666057.097062:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666057.097064:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666057.097066:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666057.097082:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186156544:0@lo:103: 00000100:00100000:1.0:1788666057.098968:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fe680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5824:1875552186156416:0@lo:104: 00010000:00010000:1.0:1788666057.099003:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab280030000/0x96bbe788361e98e4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666057.099298:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666057.099503:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186156544 00000100:00100000:3.0:1788666057.099511:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186156544 00010000:00010000:3.0:1788666057.099555:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab2a1d7c400/0x96bbe788361e9827 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9820 expref: 15 pid: 5802 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666057.099617:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788666057.099627:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b9dd2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:633727f4-1aad-4438-919b-34cfb144e459+15:3278:x1875552186156544:12345-0@lo:103: 00010000:00010000:3.0:1788666057.099802:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666057.099809:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab2a1d7c400/0x96bbe788361e9827 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9820 expref: 15 pid: 5802 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666057.099821:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab2a1d7c400/0x96bbe788361e9827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e9820 expref: 15 pid: 5802 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666057.099841:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2a1d7c400/0x96bbe788361e9827 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e9820 expref: 15 pid: 5802 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666057.099860:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab280030000/0x96bbe788361e98e4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666057.099870:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab280030000/0x96bbe788361e98e4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788666057.099887:0:5794:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006572665s 00010000:00010000:3.0:1788666057.099892:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab280030000/0x96bbe788361e98e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666057.099898:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab280030000/0x96bbe788361e98e4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666057.099905:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab280030000/0x96bbe788361e98e4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666057.099925:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab280030000/0x96bbe788361e98e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666057.099930:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab280030000 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666057.099934:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab280030000/0x96bbe788361e98e4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666057.099942:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab280030000/0x96bbe788361e98e4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666057.099959:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab280030000/0x96bbe788361e98e4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666057.099968:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666057.100019:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b9dd2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:633727f4-1aad-4438-919b-34cfb144e459+14:3278:x1875552186156544:12345-0@lo:103: Request processed in 393us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666057.100032:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788666057.100124:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186156544:0@lo:103: 00010000:00010000:1.0:1788666057.100252:0:5824:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab280030000/0x96bbe788361e98e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666057.100261:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab280030000/0x96bbe788361e98e4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666057.100267:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab280030000/0x96bbe788361e98e4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666057.103559:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+13:7588:x1875552186155776:12345-0@lo:253: Request processed in 38267us (40024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666057.103574:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788666057.104052:0:7588:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:633727f4-1aad-4438-919b-34cfb144e459:7588:1875552186155776:0@lo:253: 10000000:01000000:3.0:1788666057.104067:0:7588:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788666057.104070:0:7588:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788666057.104072:0:7588:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788666057.104073:0:7588:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666057.104074:0:7588:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666057.104075:0:7588:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666057.104076:0:7588:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666057.104078:0:7588:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788666057.104080:0:7588:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788666057.104081:0:7588:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788666057.104083:0:7588:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666057.104085:0:7588:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788666057.104200:0:7588:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788666057.122426:0:7588:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788666057.124324:0:7588:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788666057.124940:0:7588:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788666057.125376:0:7588:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788666057.125882:0:7588:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788666057.126374:0:7588:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788666057.127988:0:7588:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788666057.500537:0:7588:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788666057.500555:0:7588:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788666057.500651:0:7588:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788666057.500700:0:7588:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.125@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788666057.500710:0:7588:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788666057.500743:0:7588:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788666057.744181:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666058.638989:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186156672:0@lo:13: 00000100:00100000:3.0:1788666058.639058:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666058.639147:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186156672 00000100:00100000:3.0:1788666058.639154:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186156672 00000100:00100000:3.0:1788666058.639198:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788666058.639206:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186156672:12345-0@lo:13: 00002000:00000024:3.0:1788666058.639239:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666058.639281:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186156672:12345-0@lo:13: Request processed in 76us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666058.639289:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788666058.639328:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2b46b6a00 x1875552186156672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666074 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666058.639345:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186156672:0@lo:13: 00010000:00010000:0.0:1788666058.762880:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666059.786853:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666060.813012:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666061.838534:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788666062.218752:0:5804:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788666062.218759:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff8ab2bcd59800 from 30 10000000:01000000:2.0:1788666062.218764:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788666062.218801:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4c00/0x96bbe788361e98eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666062.218811:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4c00/0x96bbe788361e98eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666062.218819:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4c00/0x96bbe788361e98eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666062.218838:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186156800:0@lo:101: 00000100:00100000:2.0:1788666062.218897:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666062.218945:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab183862b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788666062.220301:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186157312:0@lo:400: 00000100:00100000:2.0:1788666062.220326:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186156800 00000100:00100000:2.0:1788666062.220339:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186156800 00000100:00100000:3.0:1788666062.220425:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666062.220447:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788666062.220456:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+13:5804:x1875552186156800:12345-0@lo:101: 00000100:00100000:3.0:1788666062.220463:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1788666062.220470:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1788666062.220471:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186156928:0@lo:400: 00010000:00010000:2.0:1788666062.220485:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361e98f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e98eb expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666062.220499:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788666062.220508:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361e98f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e98eb expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666062.220518:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361e98f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e98eb expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666062.220525:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186157056:0@lo:400: 00010000:00010000:2.0:1788666062.220526:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd5c00, rc 0) 00000100:00100000:3.0:1788666062.220554:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666062.220575:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+14:5804:x1875552186156800:12345-0@lo:101: Request processed in 120us (1676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666062.220595:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788666062.220603:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788666062.220610:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186157184:0@lo:400: 00000100:00100000:2.0:1788666062.220648:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186156800:0@lo:101: 00010000:00010000:2.0:1788666062.220675:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4c00/0x96bbe788361e98eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e98f2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666062.220685:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4c00/0x96bbe788361e98eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e98f2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666062.220728:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186157440:0@lo:501: 00000100:00100000:3.0:1788666062.221310:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666062.221327:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666062.221352:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab183862b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788666062.221365:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186157440 00000100:00100000:2.0:1788666062.221368:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186157440 00000100:00100000:2.0:1788666062.221395:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788666062.221399:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298878050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+14:5804:x1875552186157440:12345-0@lo:501: 00000100:00100000:3.0:1788666062.221425:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186157312 00000100:00100000:3.0:1788666062.221432:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186157312 00000100:00100000:3.0:1788666062.221472:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186156928 00000100:00100000:3.0:1788666062.221476:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186156928 00000100:00100000:3.0:1788666062.221489:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186157056 00000100:00100000:3.0:1788666062.221491:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186157056 00000100:00100000:3.0:1788666062.221503:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788666062.221509:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186157312:12345-0@lo:400: 00000100:00100000:3.0:1788666062.221553:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186157312:12345-0@lo:400: Request processed in 43us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666062.221560:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788666062.221575:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788666062.221609:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186156928:12345-0@lo:400: 00000100:00100000:3.0:1788666062.221644:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186156928:12345-0@lo:400: Request processed in 63us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666062.221650:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788666062.221677:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788666062.221685:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186157056:12345-0@lo:400: 00000100:00100000:3.0:1788666062.221724:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186157056:12345-0@lo:400: Request processed in 40us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666062.221730:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788666062.221743:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298878050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+14:5804:x1875552186157440:12345-0@lo:501: Request processed in 342us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666062.221748:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788666062.221790:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186157440:0@lo:501: 00000100:00100000:2.0:1788666062.221812:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186157568:0@lo:503: 00000100:00100000:2.0:1788666062.221843:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666062.221859:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab183862b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788666062.221868:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186157568 00000100:00100000:2.0:1788666062.221870:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186157568 00000100:00100000:2.0:1788666062.221886:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788666062.221891:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+14:5804:x1875552186157568:12345-0@lo:503: 00000100:00100000:2.0:1788666062.223679:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+14:5804:x1875552186157568:12345-0@lo:503: Request processed in 1779us (1827us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666062.223692:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788666062.225037:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186157184 00000100:00100000:3.0:1788666062.225051:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186157184 00000100:00100000:3.0:1788666062.225117:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788666062.225125:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186157184:12345-0@lo:400: 00000100:00100000:3.0:1788666062.225197:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186157184:12345-0@lo:400: Request processed in 73us (3889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666062.225211:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788666062.225230:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788666062.225235:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788666062.225270:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2b46b6a00 x1875552186156928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666062.225284:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186156928:0@lo:400: 00010000:00080000:3.0:1788666062.225299:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2b46b4700 x1875552186157312/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666062.225307:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186157312:0@lo:400: 00010000:00080000:3.0:1788666062.225343:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2b46b7800 x1875552186157184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666062.225352:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186157184:0@lo:400: 00010000:00080000:3.0:1788666062.225363:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2b46b7100 x1875552186157056/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666078 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666062.225370:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186157056:0@lo:400: 00000100:00100000:0.0:1788666062.226159:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186157568:0@lo:503: 00000100:00100000:3.0:1788666062.228281:0:7863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:7863:1875552186157696:0@lo:502: 00000100:00100000:3.0:1788666062.228443:0:7863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666062.229381:0:7863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab182357300 going to sleep for 11 seconds 00000100:00100000:2.0:1788666062.234171:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186157696 00000100:00100000:2.0:1788666062.234190:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186157696 00000100:00100000:2.0:1788666062.234259:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788666062.234269:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+14:7863:x1875552186157696:12345-0@lo:502: 00000100:00100000:2.0:1788666062.234673:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+14:7863:x1875552186157696:12345-0@lo:502: Request processed in 405us (6229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666062.234681:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788666062.234773:0:7863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:7863:1875552186157696:0@lo:502: 00000100:00100000:2.0:1788666062.234842:0:7863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:7863:1875552186157824:0@lo:502: 00000100:00100000:2.0:1788666062.235171:0:7863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666062.235241:0:7863:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab183862840 going to sleep for 11 seconds 00000100:00100000:1.0:1788666062.239451:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186157824 00000100:00100000:1.0:1788666062.239465:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186157824 00000100:00100000:1.0:1788666062.239525:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788666062.239535:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+14:7863:x1875552186157824:12345-0@lo:502: 00000100:00100000:1.0:1788666062.240045:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+14:7863:x1875552186157824:12345-0@lo:502: Request processed in 511us (4874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666062.240053:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788666062.240651:0:7863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:7863:1875552186157824:0@lo:502: 00000040:00080000:3.0:1788666062.240701:0:7863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788666062.241139:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788666062.241160:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788666062.241170:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4c00/0x96bbe788361e98eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e98f2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666062.241180:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4c00/0x96bbe788361e98eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e98f2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666062.241190:0:5804:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788666062.241199:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788666062.241202:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788666062.241304:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7ce00/0x96bbe788361e98f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666062.241312:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7ce00/0x96bbe788361e98f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666062.241320:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7ce00/0x96bbe788361e98f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666062.241338:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b422a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186157952:0@lo:101: 00000100:00100000:1.0:1788666062.241445:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666062.241483:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bbe86a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788666062.241643:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186157952 00000100:00100000:3.0:1788666062.241649:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186157952 00000100:00100000:3.0:1788666062.241697:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788666062.241706:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+14:5804:x1875552186157952:12345-0@lo:101: 00010000:00010000:3.0:1788666062.241724:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666062.242287:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9900 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e98f9 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666062.242314:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e98f9 expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666062.242324:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e98f9 expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666062.242332:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814ff000, rc 0) 00000100:00100000:3.0:1788666062.242475:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+15:5804:x1875552186157952:12345-0@lo:101: Request processed in 770us (1030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666062.242482:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788666062.242844:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b422a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186157952:0@lo:101: 00010000:00010000:2.0:1788666062.242861:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7ce00/0x96bbe788361e98f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666062.243293:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7ce00/0x96bbe788361e98f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666062.243510:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186158080:0@lo:501: 00000100:00100000:2.0:1788666062.243550:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666062.243612:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28a9e5240 going to sleep for 11 seconds 00000100:00100000:3.0:1788666062.243723:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186158080 00000100:00100000:3.0:1788666062.243730:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186158080 00000100:00100000:2.0:1788666062.244089:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788666062.244099:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+15:5804:x1875552186158080:12345-0@lo:501: 00000100:00100000:2.0:1788666062.244390:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+15:5804:x1875552186158080:12345-0@lo:501: Request processed in 292us (839us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666062.244397:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788666062.244472:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186158080:0@lo:501: 00000100:00100000:3.0:1788666062.244503:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186158208:0@lo:503: 00000100:00100000:3.0:1788666062.244543:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666062.244572:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab182357b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788666062.244818:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186158208 00000100:00100000:2.0:1788666062.244824:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186158208 00000100:00100000:2.0:1788666062.244856:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788666062.244863:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+15:5804:x1875552186158208:12345-0@lo:503: 00000100:00100000:2.0:1788666062.245152:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+15:5804:x1875552186158208:12345-0@lo:503: Request processed in 289us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666062.245159:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788666062.245240:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186158208:0@lo:503: 00000100:00100000:3.0:1788666062.245729:0:7865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:7865:1875552186158336:0@lo:502: 00000100:00100000:3.0:1788666062.245784:0:7865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666062.245809:0:7865:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab182357840 going to sleep for 11 seconds 00000100:00100000:2.0:1788666062.245957:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186158336 00000100:00100000:2.0:1788666062.245963:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186158336 00000100:00100000:2.0:1788666062.245995:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788666062.246010:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+15:7865:x1875552186158336:12345-0@lo:502: 00000100:00100000:2.0:1788666062.246195:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+15:7865:x1875552186158336:12345-0@lo:502: Request processed in 185us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666062.246202:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788666062.246252:0:7865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:7865:1875552186158336:0@lo:502: 00000020:01000000:2.0:1788666062.246274:0:7865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788666062.246283:0:7865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666062.246286:0:7865:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788666062.246290:0:7865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788666062.246292:0:7865:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788666062.246306:0:7865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:7865:1875552186158464:0@lo:502: 00000100:00100000:2.0:1788666062.246350:0:7865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666062.246371:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186158464 00000100:00100000:2.0:1788666062.246374:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186158464 00000100:00100000:2.0:1788666062.246389:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788666062.246393:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+15:7865:x1875552186158464:12345-0@lo:502: 00000100:00100000:2.0:1788666062.246502:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+15:7865:x1875552186158464:12345-0@lo:502: Request processed in 107us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666062.246509:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788666062.246534:0:7865:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28626af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666062.246544:0:7865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:7865:1875552186158464:0@lo:502: 00000020:01000000:2.0:1788666062.246559:0:7865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788666062.246563:0:7865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666062.246565:0:7865:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788666062.246568:0:7865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788666062.246644:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788666062.246677:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788666062.246689:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7ce00/0x96bbe788361e98f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666062.246707:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7ce00/0x96bbe788361e98f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666062.246717:0:5804:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788666062.246720:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff8ab290a54800 from 30 10000000:01000000:2.0:1788666062.246723:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788666062.246757:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666062.246765:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666062.246774:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9907 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666062.246785:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186158592:0@lo:101: 00000100:00100000:2.0:1788666062.246811:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666062.246824:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28626af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666062.246835:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186158592 00000100:00100000:2.0:1788666062.246839:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186158592 00000100:00100000:2.0:1788666062.246856:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788666062.246862:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+15:5804:x1875552186158592:12345-0@lo:101: 00010000:00010000:2.0:1788666062.246880:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666062.246894:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab283fd4800/0x96bbe788361e990e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e9907 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666062.246915:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab283fd4800/0x96bbe788361e990e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e9907 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666062.246934:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab283fd4800/0x96bbe788361e990e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9907 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666062.246943:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd4800, rc 0) 00000100:00100000:2.0:1788666062.246970:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+16:5804:x1875552186158592:12345-0@lo:101: Request processed in 108us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666062.246975:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788666062.247002:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186158592:0@lo:101: 00010000:00010000:2.0:1788666062.247013:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9907 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e990e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666062.247020:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9907 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e990e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666062.247054:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186158720:0@lo:501: 00000100:00100000:2.0:1788666062.247075:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666062.247102:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28626af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666062.247190:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186158720 00000100:00100000:2.0:1788666062.247194:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186158720 00000100:00100000:2.0:1788666062.247210:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788666062.247216:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+16:5804:x1875552186158720:12345-0@lo:501: 00000100:00100000:2.0:1788666062.247412:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+16:5804:x1875552186158720:12345-0@lo:501: Request processed in 196us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666062.247418:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788666062.247444:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186158720:0@lo:501: 00000100:00100000:2.0:1788666062.247463:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186158848:0@lo:503: 00000100:00100000:2.0:1788666062.247499:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666062.247511:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28626af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666062.247521:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186158848 00000100:00100000:2.0:1788666062.247524:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186158848 00000100:00100000:2.0:1788666062.247539:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788666062.247544:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+16:5804:x1875552186158848:12345-0@lo:503: 00000100:00100000:2.0:1788666062.247688:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+16:5804:x1875552186158848:12345-0@lo:503: Request processed in 143us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666062.247694:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788666062.247724:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186158848:0@lo:503: 00000100:00100000:0.0:1788666062.249507:0:7866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:7866:1875552186158976:0@lo:502: 00000100:00100000:0.0:1788666062.249610:0:7866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666062.249661:0:7866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2b4a2a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666062.249727:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186158976 00000100:00100000:1.0:1788666062.249745:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186158976 00000100:00100000:1.0:1788666062.249792:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788666062.249800:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+16:7866:x1875552186158976:12345-0@lo:502: 00000100:00100000:1.0:1788666062.250015:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+16:7866:x1875552186158976:12345-0@lo:502: Request processed in 215us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666062.250021:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788666062.250165:0:7866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:7866:1875552186158976:0@lo:502: 00000100:00100000:0.0:1788666062.250214:0:7866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:7866:1875552186159104:0@lo:502: 00000100:00100000:0.0:1788666062.250268:0:7866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666062.250293:0:7866:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29053e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788666062.250902:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186159104 00000100:00100000:1.0:1788666062.250910:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186159104 00000100:00100000:1.0:1788666062.250942:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788666062.250949:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+16:7866:x1875552186159104:12345-0@lo:502: 00000100:00100000:1.0:1788666062.251122:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+16:7866:x1875552186159104:12345-0@lo:502: Request processed in 173us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666062.251129:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788666062.251469:0:7866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989ffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:7866:1875552186159104:0@lo:502: 00000040:00080000:0.0:1788666062.251496:0:7866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788666062.251756:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788666062.251781:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788666062.251791:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9907 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e990e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666062.251801:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e990e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666062.251809:0:5804:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788666062.251812:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff8ab290a54800 from 5 10000000:01000000:1.0:1788666062.251815:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788666062.251845:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7da00/0x96bbe788361e9915 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666062.251852:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7da00/0x96bbe788361e9915 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666062.251861:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7da00/0x96bbe788361e9915 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666062.251885:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4229500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186159232:0@lo:101: 00000100:00100000:1.0:1788666062.251923:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666062.251954:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bbe86a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788666062.252095:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186159232 00000100:00100000:0.0:1788666062.252100:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186159232 00000100:00100000:0.0:1788666062.252135:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788666062.252142:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+16:5804:x1875552186159232:12345-0@lo:101: 00010000:00010000:0.0:1788666062.252152:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666062.252165:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab280031600/0x96bbe788361e991c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e9915 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666062.252186:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab280031600/0x96bbe788361e991c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e9915 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666062.252196:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab280031600/0x96bbe788361e991c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9915 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666062.252205:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab280031600, rc 0) 00000100:00100000:0.0:1788666062.252249:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186159232:12345-0@lo:101: Request processed in 107us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666062.252255:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788666062.255017:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4229500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186159232:0@lo:101: 00010000:00010000:1.0:1788666062.255048:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7da00/0x96bbe788361e9915 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e991c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666062.255062:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7da00/0x96bbe788361e9915 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e991c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666062.255131:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4229500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186159360:0@lo:256: 00000100:00100000:1.0:1788666062.255205:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666062.255256:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bbe86a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788666062.255276:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186159360 00000100:00100000:1.0:1788666062.255282:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186159360 00000100:00100000:1.0:1788666062.255324:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788666062.255332:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186159360:12345-0@lo:256: 20000000:01000000:1.0:1788666062.255553:0:5801:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788666062.255571:0:5801:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788666062.255574:0:5801:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788666062.255695:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186159360:12345-0@lo:256: Request processed in 362us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666062.255702:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788666062.255834:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4229500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186159360:0@lo:256: 10000000:01000000:0.0:1788666062.255947:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788666062.255954:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7da00/0x96bbe788361e9915 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e991c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666062.255964:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7da00/0x96bbe788361e9915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e991c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666062.255978:0:5804:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788666062.255980:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788666062.255984:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788666062.256007:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab280031800/0x96bbe788361e9923 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666062.256014:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab280031800/0x96bbe788361e9923 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666062.256022:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab280031800/0x96bbe788361e9923 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666062.256035:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186159488:0@lo:101: 00000100:00100000:0.0:1788666062.256064:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666062.256093:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bbe86a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788666062.256291:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186159488 00000100:00100000:1.0:1788666062.256297:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186159488 00000100:00100000:1.0:1788666062.256322:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788666062.256329:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186159488:12345-0@lo:101: 00010000:00010000:1.0:1788666062.256406:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666062.256418:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2a1d7ca00/0x96bbe788361e992a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e9923 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666062.256440:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2a1d7ca00/0x96bbe788361e992a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e9923 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666062.256450:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2a1d7ca00/0x96bbe788361e992a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9923 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666062.256458:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2a1d7ca00, rc 0) 00000100:00100000:1.0:1788666062.256490:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186159488:12345-0@lo:101: Request processed in 162us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666062.256504:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788666062.256536:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186159488:0@lo:101: 00010000:00010000:1.0:1788666062.256547:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab280031800/0x96bbe788361e9923 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e992a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666062.256556:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab280031800/0x96bbe788361e9923 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e992a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666062.256623:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b422a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186159616:0@lo:501: 00000100:00100000:1.0:1788666062.256646:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666062.256671:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab18262b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788666062.256683:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186159616 00000100:00100000:1.0:1788666062.256686:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186159616 00000100:00100000:1.0:1788666062.256708:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788666062.256713:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186159616:12345-0@lo:501: 00000100:00100000:1.0:1788666062.259092:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186159616:12345-0@lo:501: Request processed in 2370us (2437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666062.259105:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788666062.259183:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b422a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186159616:0@lo:501: 00000100:00100000:2.0:1788666062.259298:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186159744:0@lo:503: 00000100:00100000:2.0:1788666062.259409:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666062.259470:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28626a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788666062.259873:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186159744 00000100:00100000:1.0:1788666062.259880:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186159744 00000100:00100000:1.0:1788666062.259926:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788666062.259935:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186159744:12345-0@lo:503: 00000100:00100000:1.0:1788666062.260269:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186159744:12345-0@lo:503: Request processed in 335us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666062.260276:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788666062.260323:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186159744:0@lo:503: 00000100:00100000:1.0:1788666062.260528:0:7869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4229180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:7869:1875552186159872:0@lo:502: 00000100:00100000:1.0:1788666062.260564:0:7869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666062.260607:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186159872 00000100:00100000:1.0:1788666062.260612:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186159872 00000100:00100000:1.0:1788666062.260632:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788666062.260638:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+18:7869:x1875552186159872:12345-0@lo:502: 00000100:00100000:1.0:1788666062.260868:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+18:7869:x1875552186159872:12345-0@lo:502: Request processed in 229us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666062.260875:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788666062.260910:0:7869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab18262b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666062.260922:0:7869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4229180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:7869:1875552186159872:0@lo:502: 00000020:01000000:1.0:1788666062.260944:0:7869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788666062.260952:0:7869:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788666062.260958:0:7869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666062.260961:0:7869:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788666062.260966:0:7869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788666062.260969:0:7869:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.125@tcp to nid 0x20000c0a8c97d (192.168.201.125@tcp) 00000020:01000000:1.0:1788666062.260993:0:7869:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788666062.260996:0:7869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788666062.261011:0:7869:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ab2b4820000) 00000020:00000080:1.0:1788666062.261034:0:7869:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788666062.261039:0:7869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788666062.261111:0:7869:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788666062.261116:0:7869:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788666062.261122:0:7869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96bbe788361e9938 00010000:00080000:1.0:1788666062.261148:0:7869:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab18119c800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.125@tcp at head 00010000:00010000:1.0:1788666062.261366:0:7869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788666062.261689:0:7869:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788666062.261706:0:7869:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788666062.262210:0:7869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788666062.262409:0:7869:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788666062.262460:0:7869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788666062.262516:0:7869:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788666062.270787:0:7870:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788666062.270794:0:7870:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788666062.275545:0:7869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788666062.275560:0:7869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788666062.275785:0:7869:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788666062.275807:0:7869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96bbe788361e993f 00000100:00080000:0.0:1788666062.275818:0:7869:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788666062.275824:0:7869:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ab18119c800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1788666062.275857:0:7869:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab2989ffb80 x1875552186160000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788666062.275914:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186160000:0@lo:8: 00000100:00100000:3.0:1788666062.275979:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788666062.276041:0:7869:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788666062.276090:0:7869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788666062.276094:0:7869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666062.276096:0:7869:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788666062.276099:0:7869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788666062.276107:0:7869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666062.276109:0:7869:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788666062.276113:0:7869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788666062.276114:0:7869:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788666062.276152:0:7869:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:7869:1875552186160128:0@lo:502: 00000100:00100000:0.0:1788666062.276193:0:7869:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666062.276209:0:7869:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29053e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788666062.277724:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186160000 00000100:00100000:0.0:1788666062.277783:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186160128 00000100:00100000:0.0:1788666062.277790:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186160128 00000100:00100000:1.0:1788666062.277797:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186160000 00000100:00100000:0.0:1788666062.277834:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788666062.277844:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+18:7869:x1875552186160128:12345-0@lo:502: 00000100:00100000:1.0:1788666062.277869:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788666062.277874:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3274:x1875552186160000:12345-0@lo:8: 00010000:00080000:1.0:1788666062.277897:0:6651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:1.0:1788666062.277937:0:6651:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96bbe788361e9946 00002000:00100000:1.0:1788666062.277951:0:6651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ab18119b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788666062.277955:0:6651:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788666062.277958:0:6651:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788666062.278066:0:6651:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788666062.278210:0:6651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788666062.278232:0:6651:0:(import.c:65:import_set_state_nolock()) ffff8ab18119b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788666062.278296:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3274:x1875552186160000:12345-0@lo:8: Request processed in 421us (2317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666062.278304:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788666062.279415:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+18:7869:x1875552186160128:12345-0@lo:502: Request processed in 737us (2384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666062.279426:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788666062.279489:0:7869:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:7869:1875552186160128:0@lo:502: 00010000:00080000:1.0:1788666062.279495:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2989ffb80 x1875552186160000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788666072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666062.279506:0:3274:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788666062.279513:0:3274:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788666062.279520:0:3274:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000020:01000000:0.0:1788666062.279520:0:7869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000100:00080000:1.0:1788666062.279525:0:3274:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000020:00000080:0.0:1788666062.279526:0:7869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666062.279528:0:7869:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000100:00080000:1.0:1788666062.279533:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab18119c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000040:00080000:0.0:1788666062.279533:0:7869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000004:00080000:1.0:1788666062.279606:0:3274:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788666062.279613:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186160000:0@lo:8: 00000004:00080000:2.0:1788666062.280199:0:7870:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788666062.280314:0:7870:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 168988733291ns, next at 0ns, rc = 0 00000020:01000000:1.0:1788666062.280832:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1788666062.280855:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788666062.280864:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab280031800/0x96bbe788361e9923 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e992a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666062.280875:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab280031800/0x96bbe788361e9923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e992a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666062.280884:0:5804:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788666062.280887:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-sptlrpc-ffff8ab2989a4d40 from 1 10000000:01000000:1.0:1788666062.280889:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788666062.280920:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c400/0x96bbe788361e994d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666062.280927:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c400/0x96bbe788361e994d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666062.280935:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c400/0x96bbe788361e994d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666062.280955:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4229180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186160256:0@lo:101: 00000100:00100000:1.0:1788666062.281006:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666062.281044:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab18262bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788666062.281307:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186160256 00000100:00100000:0.0:1788666062.281315:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186160256 00000100:00100000:0.0:1788666062.281524:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788666062.281533:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186160256:12345-0@lo:101: 00010000:00010000:0.0:1788666062.281547:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666062.281559:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab280030600/0x96bbe788361e9954 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e994d expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666062.281601:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab280030600/0x96bbe788361e9954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e994d expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666062.281623:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab280030600/0x96bbe788361e9954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e994d expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666062.281632:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab280030600, rc 0) 00000100:00100000:0.0:1788666062.281686:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:5804:x1875552186160256:12345-0@lo:101: Request processed in 155us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666062.281691:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788666062.284370:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4229180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186160256:0@lo:101: 00010000:00010000:1.0:1788666062.284396:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c400/0x96bbe788361e994d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9954 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666062.284421:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c400/0x96bbe788361e994d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9954 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666062.284512:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4229180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186160384:0@lo:501: 00000100:00100000:1.0:1788666062.284565:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666062.284624:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab18262bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788666062.290711:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186160384 00000100:00100000:0.0:1788666062.290728:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186160384 00000100:00100000:0.0:1788666062.290780:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788666062.290791:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:5804:x1875552186160384:12345-0@lo:501: 00000100:00100000:0.0:1788666062.291047:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:5804:x1875552186160384:12345-0@lo:501: Request processed in 257us (6480us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788666062.291056:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788666062.291327:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4229180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186160384:0@lo:501: 10000000:01000000:1.0:1788666062.291369:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788666062.291379:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c400/0x96bbe788361e994d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9954 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666062.291389:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c400/0x96bbe788361e994d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9954 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788666062.337904:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1788666062.397007:0:7871:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788666062.397041:0:7871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989ff100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7871:1875552186160640:0@lo:7: 00000100:00100000:0.0:1788666062.397114:0:7871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666062.397163:0:7871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788666062.397180:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186160512:0@lo:13: 00000100:00100000:0.0:1788666062.397206:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666062.397244:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186160640 00000100:00100000:0.0:1788666062.397252:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186160640 00000100:00100000:0.0:1788666062.397301:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788666062.397310:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7871:x1875552186160640:12345-0@lo:7: 00000100:00100000:3.0:1788666062.400207:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186160512 00000100:00100000:3.0:1788666062.400240:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186160512 00000100:00100000:3.0:1788666062.400298:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788666062.400308:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3276:x1875552186160512:12345-0@lo:13: 00002000:00000024:3.0:1788666062.400340:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788666062.400425:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3276:x1875552186160512:12345-0@lo:13: Request processed in 118us (3217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666062.400432:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788666062.400452:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788666062.400491:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2989fe680 x1875552186160512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666062.400510:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186160512:0@lo:13: 00002000:00080000:1.0:1788666062.404339:0:6650:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788666062.404347:0:6650:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788666062.404442:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7871:x1875552186160640:12345-0@lo:7: Request processed in 7128us (7324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666062.404453:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788666062.404642:0:7871:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2989ff100 x1875552186160640/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788666078 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666062.404685:0:7871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989ff100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7871:1875552186160640:0@lo:7: 00000004:00080000:0.0:1788666062.404698:0:7871:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788666062.404732:0:7871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989ff100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7871:1875552186160768:0@lo:5: 00000100:00100000:0.0:1788666062.404763:0:7871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666062.404795:0:7871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788666062.404860:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186160768 00000100:00100000:1.0:1788666062.404867:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186160768 00000100:00100000:1.0:1788666062.404909:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788666062.404917:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7871:x1875552186160768:12345-0@lo:5: 00002000:00080000:1.0:1788666062.404942:0:6651:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788666062.404945:0:6651:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788666062.405211:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7871:x1875552186160768:12345-0@lo:5: Request processed in 293us (445us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788666062.405225:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788666062.405296:0:7871:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2989ff100 x1875552186160768/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788666078 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666062.405308:0:7871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989ff100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7871:1875552186160768:0@lo:5: 00000004:00080000:0.0:1788666062.405317:0:7871:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788666062.405342:0:7871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7871:1875552186160896:0@lo:700: 00000100:00100000:0.0:1788666062.405365:0:7871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666062.405388:0:7871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788666062.405443:0:6657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186160896 00000100:00100000:1.0:1788666062.405448:0:6657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186160896 00000100:00100000:1.0:1788666062.405524:0:6657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788666062.405531:0:6657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7871:x1875552186160896:12345-0@lo:700: 00000100:00100000:1.0:1788666062.405562:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4229180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6657:1875552186161024:0@lo:700: 00000100:00100000:1.0:1788666062.405611:0:6657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666062.405635:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab18262b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788666062.405678:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186161024 00000100:00100000:1.0:1788666062.405682:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186161024 00000100:00100000:1.0:1788666062.405709:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788666062.405714:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b422ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6657:x1875552186161024:12345-0@lo:700: 40000000:02000000:1.0:1788666062.441688:0:5815:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788666062.448698:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b422ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6657:x1875552186161024:12345-0@lo:700: Request processed in 42975us (43078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666062.448714:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788666062.448862:0:6657:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2b4229180 x1875552186161024/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788666078 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666062.448879:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4229180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6657:1875552186161024:0@lo:700: 40000000:02000000:3.0:1788666062.448892:0:6657:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:1.0:1788666062.523488:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1788666062.523511:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788666062.536183:0:6657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7871:x1875552186160896:12345-0@lo:700: Request processed in 130643us (130807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666062.536199:0:6657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788666062.536305:0:7871:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2989fd180 x1875552186160896/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788666078 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666062.536318:0:7871:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788666062.536335:0:7871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7871:1875552186160896:0@lo:700: 00000004:02000040:0.0:1788666062.580528:0:7871:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1788666062.584342:0:7871:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7871:1875552186161152:0@lo:5: 00000100:00100000:0.0:1788666062.584412:0:7871:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666062.584507:0:7871:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516240 going to sleep for 11 seconds 00000100:00100000:1.0:1788666062.587535:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186161152 00000100:00100000:1.0:1788666062.587551:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186161152 00000100:00100000:1.0:1788666062.587630:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788666062.587641:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7871:x1875552186161152:12345-0@lo:5: 00002000:00080000:1.0:1788666062.592887:0:6650:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788666062.592908:0:6650:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788666062.596176:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7871:x1875552186161152:12345-0@lo:5: Request processed in 8530us (11757us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788666062.596197:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1788666062.596362:0:7871:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2989fd180 x1875552186161152/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788666078 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666062.596381:0:7871:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7871:1875552186161152:0@lo:5: 00000004:00080000:3.0:1788666062.596397:0:7871:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1788666062.859839:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666063.755777:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186161280:0@lo:13: 00000100:00100000:1.0:1788666063.755862:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666063.756689:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186161280 00000100:00100000:3.0:1788666063.756704:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186161280 00000100:00100000:3.0:1788666063.756787:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788666063.756798:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186161280:12345-0@lo:13: 00002000:00000024:3.0:1788666063.756845:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666063.756910:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186161280:12345-0@lo:13: Request processed in 114us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666063.756917:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788666063.757101:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2b46b6a00 x1875552186161280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666079 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666063.757122:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186161280:0@lo:13: 00010000:00010000:1.0:1788666063.883787:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788666063.975133:0:7950:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788666064.907246:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666065.931110:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666066.970295:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666067.339453:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186161408:0@lo:400: 00000100:00100000:3.0:1788666067.339532:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666067.340420:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186161408 00000100:00100000:1.0:1788666067.340432:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186161408 00000100:00100000:1.0:1788666067.340488:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788666067.340497:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3278:x1875552186161408:12345-0@lo:400: 00000100:00100000:1.0:1788666067.342439:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3278:x1875552186161408:12345-0@lo:400: Request processed in 1935us (2899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666067.342455:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788666067.344274:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186161792:0@lo:400: 00000100:00100000:2.0:1788666067.344347:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666067.344383:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666067.344388:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3277:1875552186161920:0@lo:400: 00000100:00100000:2.0:1788666067.344410:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666067.344442:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186161792 00000100:00100000:2.0:1788666067.344449:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186161792 00000100:00100000:2.0:1788666067.344503:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788666067.344513:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186161792:12345-0@lo:400: 00000100:00100000:2.0:1788666067.344599:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186161792:12345-0@lo:400: Request processed in 66us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666067.344606:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788666067.344624:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788666067.344654:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bc3f0a80 x1875552186161792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666067.344667:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186161792:0@lo:400: 00000100:00100000:2.0:1788666067.345045:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3276:1875552186161664:0@lo:400: 00000100:00100000:2.0:1788666067.345075:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666067.345104:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788666067.345110:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186161536:0@lo:400: 00000100:00100000:2.0:1788666067.345128:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666067.345143:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186162048:0@lo:400: 00000100:00100000:2.0:1788666067.345163:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666067.345224:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186161920 00000100:00100000:0.0:1788666067.345236:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186161920 00000100:00100000:0.0:1788666067.345274:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186161664 00000100:00100000:0.0:1788666067.345276:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186161664 00000100:00080000:2.0:1788666067.345354:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666067.345380:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186161536 00000100:00100000:0.0:1788666067.345383:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186161536 00000100:00100000:0.0:1788666067.345398:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788666067.345404:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875552186161920:12345-0@lo:400: 00000100:00100000:0.0:1788666067.345451:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875552186161920:12345-0@lo:400: Request processed in 48us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666067.345457:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788666067.345469:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788666067.345475:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875552186161664:12345-0@lo:400: 00000100:00100000:0.0:1788666067.345502:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875552186161664:12345-0@lo:400: Request processed in 27us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666067.345507:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788666067.345518:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788666067.345523:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186161536:12345-0@lo:400: 00000100:00100000:0.0:1788666067.345546:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186161536:12345-0@lo:400: Request processed in 23us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666067.345552:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788666067.345616:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bc3f0700 x1875552186161536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666067.345627:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186161536:0@lo:400: 00010000:00080000:2.0:1788666067.345636:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bc3f2a00 x1875552186161664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666067.345645:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3276:1875552186161664:0@lo:400: 00010000:00080000:2.0:1788666067.345674:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bc3f0380 x1875552186161920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666067.345683:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3277:1875552186161920:0@lo:400: 00000100:00100000:0.0:1788666067.345753:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186162048 00000100:00100000:0.0:1788666067.345757:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186162048 00000100:00100000:0.0:1788666067.345817:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788666067.345823:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3276:x1875552186162048:12345-0@lo:400: 00000100:00100000:0.0:1788666067.345854:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3276:x1875552186162048:12345-0@lo:400: Request processed in 31us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666067.345859:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788666067.345932:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186161408:0@lo:400: 00010000:00080000:1.0:1788666067.347796:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bc3f3b80 x1875552186162048/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666083 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666067.347815:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186162048:0@lo:400: 00000100:00080000:2.0:1788666067.348785:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788666067.852476:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186162176:0@lo:13: 00000100:00100000:3.0:1788666067.852540:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666067.852696:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186162176 00000100:00100000:0.0:1788666067.852714:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186162176 00000100:00100000:0.0:1788666067.852776:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788666067.852786:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1875552186162176:12345-0@lo:13: 00002000:00000024:0.0:1788666067.852819:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666067.852863:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1875552186162176:12345-0@lo:13: Request processed in 79us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666067.852871:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788666067.856216:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2989fc700 x1875552186162176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666067.856250:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186162176:0@lo:13: 00000001:00080000:2.0:1788666067.948713:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1788666067.978829:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666068.880847:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186162304:0@lo:13: 00000100:00100000:3.0:1788666068.880931:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666068.882876:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186162304 00000100:00100000:1.0:1788666068.882906:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186162304 00000100:00100000:1.0:1788666068.882968:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788666068.882979:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186162304:12345-0@lo:13: 00002000:00000024:1.0:1788666068.883021:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666068.883105:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186162304:12345-0@lo:13: Request processed in 128us (2173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666068.883125:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788666068.888362:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2b46b5180 x1875552186162304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666084 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666068.888402:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186162304:0@lo:13: 00010000:00010000:2.0:1788666069.004196:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666069.497166:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666069.497208:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173555840 00000100:00100000:3.0:1788666069.497219:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173555840 00000100:00100000:3.0:1788666069.497259:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 111 00000100:00100000:3.0:1788666069.497266:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2357:x1875552173555840:12345-192.168.201.25@tcp:250: 00010000:00080000:3.0:1788666069.497297:0:5800:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 17385a9f-d911-4baa-b21a-4b6dd266f57e@192.168.201.25@tcp t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:3.0:1788666069.497337:0:5800:0:(genops.c:1385:class_connect()) connect: client 17385a9f-d911-4baa-b21a-4b6dd266f57e, cookie 0x96bbe788361e995b 00000100:00080000:3.0:1788666069.497486:0:5800:0:(import.c:65:import_set_state_nolock()) ffff8ab2b44db000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788666069.497611:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+5:2357:x1875552173555840:12345-192.168.201.25@tcp:250: Request processed in 314us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666069.497620:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 111 00000100:00100000:0.0:1788666069.506071:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666069.506138:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173555968 00000100:00100000:2.0:1788666069.506147:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173555968 00000100:00100000:2.0:1788666069.506196:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 112 00000100:00100000:2.0:1788666069.506206:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+5:5589:x1875552173555968:12345-192.168.201.25@tcp:101: 00010000:00010000:2.0:1788666069.506223:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666069.506238:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab283fd5400/0x96bbe788361e9962 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42780 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666069.506265:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab283fd5400/0x96bbe788361e9962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42780 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666069.506276:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab283fd5400/0x96bbe788361e9962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42780 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666069.506286:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd5400, rc 0) 00000100:00100000:2.0:1788666069.506345:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+6:5589:x1875552173555968:12345-192.168.201.25@tcp:101: Request processed in 140us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666069.506352:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 112 00000100:00100000:0.0:1788666069.517147:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666069.517234:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173556096 00000100:00100000:3.0:1788666069.517248:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173556096 00000100:00100000:3.0:1788666069.517314:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 113 00000100:00100000:3.0:1788666069.517325:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+6:5589:x1875552173556096:12345-192.168.201.25@tcp:501: 00000100:00100000:3.0:1788666069.518081:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+6:5589:x1875552173556096:12345-192.168.201.25@tcp:501: Request processed in 753us (937us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788666069.518091:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 113 00000100:00100000:1.0:1788666069.540654:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666069.541765:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173556224 00000100:00100000:2.0:1788666069.541780:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173556224 00000100:00100000:2.0:1788666069.541848:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 114 00000100:00100000:2.0:1788666069.541859:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+6:5589:x1875552173556224:12345-192.168.201.25@tcp:101: 00010000:00010000:2.0:1788666069.541886:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666069.541903:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab283fd4600/0x96bbe788361e9969 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42787 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666069.541950:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab283fd4600/0x96bbe788361e9969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42787 expref: 7 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666069.541962:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab283fd4600/0x96bbe788361e9969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42787 expref: 7 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666069.541971:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd4600, rc 0) 00000100:00100000:2.0:1788666069.542023:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+7:5589:x1875552173556224:12345-192.168.201.25@tcp:101: Request processed in 166us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666069.542030:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 114 00000100:00100000:0.0:1788666069.572309:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666069.573237:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173556352 00000100:00100000:1.0:1788666069.573251:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173556352 00000100:00100000:1.0:1788666069.573317:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 115 00000100:00100000:1.0:1788666069.573328:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+7:5589:x1875552173556352:12345-192.168.201.25@tcp:501: 00000100:00100000:1.0:1788666069.573915:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+8:5589:x1875552173556352:12345-192.168.201.25@tcp:501: Request processed in 587us (1613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666069.573926:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 115 00000100:00100000:0.0:1788666069.576264:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666069.576350:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173556480 00000100:00100000:1.0:1788666069.576362:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173556480 00000100:00100000:1.0:1788666069.576467:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 116 00000100:00100000:1.0:1788666069.576478:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+8:5589:x1875552173556480:12345-192.168.201.25@tcp:503: 00000100:00100000:1.0:1788666069.577125:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+8:5589:x1875552173556480:12345-192.168.201.25@tcp:503: Request processed in 645us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666069.577136:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 116 00000100:00100000:0.0:1788666069.580905:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666069.581005:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173556608 00000100:00100000:2.0:1788666069.581016:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173556608 00000100:00100000:2.0:1788666069.581070:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 117 00000100:00100000:2.0:1788666069.581081:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+8:5607:x1875552173556608:12345-192.168.201.25@tcp:502: 00000100:00100000:2.0:1788666069.581742:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+8:5607:x1875552173556608:12345-192.168.201.25@tcp:502: Request processed in 660us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666069.581751:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 117 00000100:00100000:0.0:1788666069.612085:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666069.612205:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173556736 00000100:00100000:2.0:1788666069.612219:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173556736 00000100:00100000:2.0:1788666069.612287:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 118 00000100:00100000:2.0:1788666069.612297:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+8:5607:x1875552173556736:12345-192.168.201.25@tcp:502: 00000100:00100000:2.0:1788666069.612852:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+8:5607:x1875552173556736:12345-192.168.201.25@tcp:502: Request processed in 554us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666069.612861:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 118 00000100:00100000:2.0:1788666069.629561:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666069.630186:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173556864 00000100:00100000:1.0:1788666069.630198:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173556864 00000100:00100000:1.0:1788666069.630262:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 119 00000100:00100000:1.0:1788666069.630272:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+8:5589:x1875552173556864:12345-192.168.201.25@tcp:101: 00010000:00010000:1.0:1788666069.630291:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666069.630310:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2a1d7dc00/0x96bbe788361e9970 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d427b1 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666069.630341:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2a1d7dc00/0x96bbe788361e9970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427b1 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666069.630366:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2a1d7dc00/0x96bbe788361e9970 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427b1 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666069.630375:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2a1d7dc00, rc 0) 00000100:00100000:1.0:1788666069.630439:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+9:5589:x1875552173556864:12345-192.168.201.25@tcp:101: Request processed in 169us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666069.630447:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 119 00000100:00100000:1.0:1788666069.639815:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666069.639949:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173556992 00000100:00100000:0.0:1788666069.639961:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173556992 00000100:00100000:0.0:1788666069.640025:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 120 00000100:00100000:0.0:1788666069.640037:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+9:5589:x1875552173556992:12345-192.168.201.25@tcp:256: 20000000:01000000:0.0:1788666069.640260:0:5800:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788666069.640290:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788666069.640295:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788666069.640299:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788666069.640302:0:5800:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788666069.642426:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+9:5589:x1875552173556992:12345-192.168.201.25@tcp:256: Request processed in 2382us (2610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666069.642439:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 120 00000100:00100000:2.0:1788666069.653206:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666069.653370:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173557120 00000100:00100000:1.0:1788666069.653381:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173557120 00000100:00100000:1.0:1788666069.653443:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 121 00000100:00100000:1.0:1788666069.653453:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+9:5589:x1875552173557120:12345-192.168.201.25@tcp:101: 00010000:00010000:1.0:1788666069.653472:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666069.653490:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361e9977 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d427b8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666069.653521:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361e9977 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427b8 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666069.653545:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361e9977 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427b8 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666069.653556:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2a1d7cc00, rc 0) 00000100:00100000:1.0:1788666069.653664:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:5589:x1875552173557120:12345-192.168.201.25@tcp:101: Request processed in 212us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666069.653671:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 121 00000100:00100000:1.0:1788666069.660141:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666069.660533:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173557248 00000100:00100000:3.0:1788666069.660545:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173557248 00000100:00100000:3.0:1788666069.660631:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 122 00000100:00100000:3.0:1788666069.660823:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:5589:x1875552173557248:12345-192.168.201.25@tcp:501: 00000100:00100000:2.0:1788666069.661620:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:5589:x1875552173557248:12345-192.168.201.25@tcp:501: Request processed in 798us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666069.661631:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 122 00000100:00100000:2.0:1788666069.668671:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666069.668910:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173557376 00000100:00100000:0.0:1788666069.668920:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173557376 00000100:00100000:0.0:1788666069.668977:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 123 00000100:00100000:0.0:1788666069.668986:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:5589:x1875552173557376:12345-192.168.201.25@tcp:503: 00000100:00100000:0.0:1788666069.669507:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:5589:x1875552173557376:12345-192.168.201.25@tcp:503: Request processed in 519us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666069.669535:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 123 00000100:00100000:0.0:1788666069.682470:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666069.683486:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173557504 00000100:00100000:2.0:1788666069.683502:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173557504 00000100:00100000:2.0:1788666069.683575:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 124 00000100:00100000:2.0:1788666069.683610:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:5612:x1875552173557504:12345-192.168.201.25@tcp:502: 00000100:00100000:2.0:1788666069.688549:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:5612:x1875552173557504:12345-192.168.201.25@tcp:502: Request processed in 4904us (6054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666069.688565:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 124 00000100:00100000:2.0:1788666069.700572:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666069.700854:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173557632 00000100:00100000:0.0:1788666069.700866:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173557632 00000100:00100000:0.0:1788666069.701011:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 125 00000100:00100000:0.0:1788666069.701023:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:5612:x1875552173557632:12345-192.168.201.25@tcp:502: 00000100:00100000:0.0:1788666069.701357:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:5612:x1875552173557632:12345-192.168.201.25@tcp:502: Request processed in 334us (795us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666069.701366:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 125 00000100:00100000:0.0:1788666069.705023:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666069.705127:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173557760 00000100:00100000:3.0:1788666069.705139:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173557760 00000100:00100000:3.0:1788666069.705195:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:3.0:1788666069.705203:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2357:x1875552173557760:12345-192.168.201.25@tcp:38: 00010000:00080000:3.0:1788666069.705238:0:5810:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:3.0:1788666069.705293:0:5810:0:(genops.c:1385:class_connect()) connect: client 0911d461-5865-4ef7-8c3e-012fc04add58, cookie 0x96bbe788361e997e 00000004:00100000:3.0:1788666069.705326:0:5810:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788666069.705346:0:5810:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788666069.793409:0:5810:0:(import.c:65:import_set_state_nolock()) ffff8ab2b44dd000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788666069.793686:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2357:x1875552173557760:12345-192.168.201.25@tcp:38: Request processed in 88480us (88675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666069.793699:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00010000:00010000:3.0:1788666070.026885:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666070.809491:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666070.810336:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173557888 00000100:00100000:3.0:1788666070.810349:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173557888 00000100:00100000:3.0:1788666070.810444:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:3.0:1788666070.810455:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:0:x1875552173557888:12345-192.168.201.25@tcp:41: 00000004:00000024:3.0:1788666070.810519:0:5808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:2.0:1788666070.811726:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666070.812664:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:0:x1875552173557888:12345-192.168.201.25@tcp:41: Request processed in 2195us (3170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666070.812680:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:2.0:1788666070.818309:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666070.825304:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173558016 00000100:00100000:3.0:1788666070.825321:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173558016 00000100:00100000:3.0:1788666070.825478:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:3.0:1788666070.825490:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+6:5589:x1875552173558016:12345-192.168.201.25@tcp:41: 00000004:00000024:3.0:1788666070.825537:0:5809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788666070.825654:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+6:5589:x1875552173558016:12345-192.168.201.25@tcp:41: Request processed in 167us (7354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666070.825661:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:2.0:1788666070.837563:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666070.837688:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173558144 00000100:00100000:0.0:1788666070.837699:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173558144 00000100:00100000:0.0:1788666070.838313:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:0.0:1788666070.838325:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+6:5589:x1875552173558144:12345-192.168.201.25@tcp:40: 00000100:00100000:0.0:1788666070.838478:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+6:5589:x1875552173558144:12345-192.168.201.25@tcp:40: Request processed in 155us (929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666070.838487:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:2.0:1788666070.841675:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666070.841811:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173558272 00000100:00100000:3.0:1788666070.841821:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173558272 00000100:00100000:3.0:1788666070.841882:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:3.0:1788666070.841891:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1875552173558272:12345-192.168.201.25@tcp:8: 00010000:00080000:3.0:1788666070.841933:0:6651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:3.0:1788666070.842097:0:6651:0:(genops.c:1385:class_connect()) connect: client 0911d461-5865-4ef7-8c3e-012fc04add58, cookie 0x96bbe788361e9985 00002000:00100000:3.0:1788666070.842111:0:6651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0911d461-5865-4ef7-8c3e-012fc04add58/ffff8ab2b44de000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788666070.842140:0:6651:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788666070.843100:0:6651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788666070.843146:0:6651:0:(import.c:65:import_set_state_nolock()) ffff8ab2ae43a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788666070.843244:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2357:x1875552173558272:12345-192.168.201.25@tcp:8: Request processed in 1351us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666070.843254:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:2.0:1788666070.846131:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666070.846221:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173558400 00000100:00100000:0.0:1788666070.846234:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173558400 00000100:00100000:0.0:1788666070.846297:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 126 00000100:00100000:0.0:1788666070.846308:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2364:x1875552173558400:12345-192.168.201.25@tcp:400: 00000100:00100000:0.0:1788666070.846389:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2364:x1875552173558400:12345-192.168.201.25@tcp:400: Request processed in 82us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666070.848067:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 126 00000100:00100000:1.0:1788666070.857435:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666070.857564:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173558528 00000100:00100000:3.0:1788666070.857576:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173558528 00000100:00100000:3.0:1788666070.857654:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:3.0:1788666070.857662:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b422a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875552173558528:12345-192.168.201.25@tcp:8: 00010000:00080000:3.0:1788666070.857704:0:6649:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp t0 exp 0000000000000000 cur 177 last 0 00000020:00000080:3.0:1788666070.857758:0:6649:0:(genops.c:1385:class_connect()) connect: client 0911d461-5865-4ef7-8c3e-012fc04add58, cookie 0x96bbe788361e998c 00002000:00100000:3.0:1788666070.857771:0:6649:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0911d461-5865-4ef7-8c3e-012fc04add58/ffff8ab2b44d8800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788666070.857800:0:6649:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788666070.858415:0:6649:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:1.0:1788666070.859670:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666070.859727:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666070.859762:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666070.859799:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173558912 00000100:00100000:1.0:1788666070.859807:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173558912 00000100:00100000:1.0:1788666070.860039:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:1.0:1788666070.860050:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b422a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173558912:12345-192.168.201.25@tcp:400: 00000100:00100000:1.0:1788666070.860133:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b422a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173558912:12345-192.168.201.25@tcp:400: Request processed in 86us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666070.860141:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:3.0:1788666070.861201:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173558656 00000100:00100000:3.0:1788666070.861213:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173558656 00000100:00100000:3.0:1788666070.861265:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:3.0:1788666070.861275:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:5589:x1875552173558656:12345-192.168.201.25@tcp:33: 00000100:00100000:0.0:1788666070.864058:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173558784 00000100:00100000:0.0:1788666070.864084:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173558784 00000100:00100000:0.0:1788666070.864150:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 127 00000100:00100000:0.0:1788666070.864160:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2363:x1875552173558784:12345-192.168.201.25@tcp:400: 00000100:00100000:0.0:1788666070.864239:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2363:x1875552173558784:12345-192.168.201.25@tcp:400: Request processed in 80us (4577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666070.864246:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 127 00000100:00080000:2.0:1788666070.866887:0:6649:0:(import.c:65:import_set_state_nolock()) ffff8ab2b44db800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788666070.867002:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b422a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:2357:x1875552173558528:12345-192.168.201.25@tcp:8: Request processed in 9334us (9575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666070.867030:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000004:00080000:3.0:1788666070.889622:0:5811:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 28272us 00000004:00200000:0.0:1788666070.926857:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788666070.926977:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:5589:x1875552173558656:12345-192.168.201.25@tcp:33: Request processed in 65698us (67242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666070.926991:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00000001:00100000:1.0:1788666071.036800:0:6678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0911d461-5865-4ef7-8c3e-012fc04add58 00010000:00010000:1.0:1788666071.053891:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666071.270689:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666071.270782:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173559040 00000100:00100000:3.0:1788666071.270792:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173559040 00000100:00100000:3.0:1788666071.270867:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:3.0:1788666071.270879:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:5629:x1875552173559040:12345-192.168.201.25@tcp:101: 00010000:00010000:3.0:1788666071.270903:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666071.270928:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff600/0x96bbe788361e9993 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d427e2 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666071.271025:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e999a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666071.271040:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e999a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666071.271055:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e999a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666071.271090:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788666071.271094:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788666071.271108:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e999a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666071.271131:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff600/0x96bbe788361e9993 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427e2 expref: 8 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666071.271149:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e999a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427e2 expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666071.271157:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:3.0:1788666071.271160:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788666071.271164:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814fe600, rc 0) 00000100:00100000:3.0:1788666071.271225:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+7:5629:x1875552173559040:12345-192.168.201.25@tcp:101: Request processed in 350us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666071.271232:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00010000:00010000:1.0:1788666072.076100:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666072.460697:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3276:1875552186162688:0@lo:400: 00000100:00100000:1.0:1788666072.460795:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666072.460925:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186162432:0@lo:400: 00000100:00100000:2.0:1788666072.461077:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b422bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186162560:0@lo:400: 00000100:00100000:0.0:1788666072.461139:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186162816:0@lo:400: 00000100:00100000:3.0:1788666072.466698:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666072.466799:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3278:1875552186162944:0@lo:400: 00000100:00100000:3.0:1788666072.467339:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666072.467413:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186162432 00000100:00100000:3.0:1788666072.467422:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186162432 00000100:00100000:3.0:1788666072.467496:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788666072.467507:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3278:x1875552186162432:12345-0@lo:400: 00000100:00100000:3.0:1788666072.467574:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3278:x1875552186162432:12345-0@lo:400: Request processed in 69us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666072.467604:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788666072.467803:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186162688 00000100:00100000:3.0:1788666072.467808:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186162688 00000100:00100000:3.0:1788666072.467868:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186162944 00000100:00100000:3.0:1788666072.467872:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186162944 00000100:00100000:3.0:1788666072.469033:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788666072.469051:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875552186162688:12345-0@lo:400: 00000100:00100000:3.0:1788666072.469134:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875552186162688:12345-0@lo:400: Request processed in 92us (8340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666072.469141:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788666072.469156:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788666072.469659:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3276:1875552186162688:0@lo:400: 00000100:00100000:1.0:1788666072.469918:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186162432:0@lo:400: 00000100:00080000:1.0:1788666072.469954:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666072.470111:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875552186162944:12345-0@lo:400: 00000100:00100000:3.0:1788666072.470188:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875552186162944:12345-0@lo:400: Request processed in 1026us (2850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666072.470268:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788666072.470561:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3278:1875552186162944:0@lo:400: 00000100:00100000:2.0:1788666072.476241:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666072.476312:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b422b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186163072:0@lo:400: 00000100:00100000:2.0:1788666072.476360:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666072.476629:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186162560 00000100:00100000:1.0:1788666072.476648:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186162560 00000100:00100000:1.0:1788666072.476708:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788666072.476719:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186162560:12345-0@lo:400: 00000100:00100000:1.0:1788666072.476788:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186162560:12345-0@lo:400: Request processed in 71us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666072.476813:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788666072.477130:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b422bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186162560:0@lo:400: 00000100:00100000:3.0:1788666072.477353:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186163072 00000100:00100000:3.0:1788666072.477358:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186163072 00000100:00100000:3.0:1788666072.477421:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788666072.477432:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186163072:12345-0@lo:400: 00000100:00100000:3.0:1788666072.477502:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186163072:12345-0@lo:400: Request processed in 74us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666072.477517:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788666072.477611:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788666072.477681:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2b422b800 x1875552186163072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666072.477692:0:3275:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788666072.477702:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b422b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186163072:0@lo:400: 00000100:00100000:0.0:1788666072.477861:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666072.477994:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186162816 00000100:00100000:2.0:1788666072.478001:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186162816 00000100:00100000:2.0:1788666072.478041:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788666072.478048:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186162816:12345-0@lo:400: 00000100:00080000:1.0:1788666072.478132:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788666072.478605:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186162816:12345-0@lo:400: Request processed in 529us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666072.478614:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788666072.479346:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2b4228a80 x1875552186162816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666072.479359:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186162816:0@lo:400: 00000100:00100000:2.0:1788666072.971180:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788666072.974366:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186163200:0@lo:13: 00000100:00100000:2.0:1788666072.974827:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666072.978851:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186163200 00000100:00100000:1.0:1788666072.978878:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186163200 00000100:00100000:1.0:1788666072.978958:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788666072.978970:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186163200:12345-0@lo:13: 00002000:00000024:1.0:1788666072.979012:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666072.979116:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186163200:12345-0@lo:13: Request processed in 149us (4290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666072.979125:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788666072.979367:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2989ffb80 x1875552186163200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666072.979388:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186163200:0@lo:13: 00010000:00010000:2.0:1788666073.108626:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666073.496422:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666073.508416:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173559168 00000100:00100000:1.0:1788666073.508433:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173559168 00000100:00100000:1.0:1788666073.508553:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:1.0:1788666073.508567:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+7:5681:x1875552173559168:12345-192.168.201.25@tcp:41: 00000100:00080000:3.0:1788666073.508609:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1788666073.508628:0:7132:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788666073.508708:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+7:5681:x1875552173559168:12345-192.168.201.25@tcp:41: Request processed in 144us (12296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666073.518017:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:1.0:1788666073.527863:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666073.527994:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173559296 00000100:00100000:0.0:1788666073.528005:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173559296 00000100:00100000:0.0:1788666073.528092:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:0.0:1788666073.528105:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0911d461-5865-4ef7-8c3e-012fc04add58+5:5681:x1875552173559296:12345-192.168.201.25@tcp:13: 00002000:00000024:0.0:1788666073.528148:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666073.528229:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae726d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0911d461-5865-4ef7-8c3e-012fc04add58+5:5681:x1875552173559296:12345-192.168.201.25@tcp:13: Request processed in 127us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666073.528252:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00080000:3.0:1788666073.528546:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788666073.530823:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666073.531278:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173559424 00000100:00100000:0.0:1788666073.531290:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173559424 00000100:00080000:3.0:1788666073.531409:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788666073.531423:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:0.0:1788666073.531436:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0911d461-5865-4ef7-8c3e-012fc04add58+6:5681:x1875552173559424:12345-192.168.201.25@tcp:13: 00002000:00000024:0.0:1788666073.531487:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666073.531559:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0911d461-5865-4ef7-8c3e-012fc04add58+6:5681:x1875552173559424:12345-192.168.201.25@tcp:13: Request processed in 126us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666073.531566:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:0.0:1788666073.994892:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186163328:0@lo:13: 00000100:00100000:0.0:1788666073.994983:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666073.996183:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186163328 00000100:00100000:2.0:1788666073.996196:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186163328 00000100:00100000:2.0:1788666073.996264:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788666073.996274:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186163328:12345-0@lo:13: 00002000:00000024:2.0:1788666073.996319:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666073.996404:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186163328:12345-0@lo:13: Request processed in 131us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666073.996411:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788666073.997295:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2b46b4380 x1875552186163328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666089 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666073.997319:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186163328:0@lo:13: 00010000:00010000:3.0:1788666074.124018:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788666075.094966:0:5830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0911d461-5865-4ef7-8c3e-012fc04add58 00000001:00100000:1.0:1788666075.103308:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0911d461-5865-4ef7-8c3e-012fc04add58 00010000:00010000:1.0:1788666075.147073:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666076.166273:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666076.166469:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666076.166631:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173559680 00000100:00100000:3.0:1788666076.166641:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173559680 00000100:00100000:3.0:1788666076.166729:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:3.0:1788666076.166745:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2361:x1875552173559680:12345-192.168.201.25@tcp:400: 00000100:00100000:3.0:1788666076.166826:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2361:x1875552173559680:12345-192.168.201.25@tcp:400: Request processed in 88us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666076.166835:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00080000:0.0:1788666076.167094:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666076.167169:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173559552 00000100:00100000:2.0:1788666076.167174:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173559552 00000100:00100000:2.0:1788666076.167207:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 129 00000100:00100000:2.0:1788666076.167215:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2361:x1875552173559552:12345-192.168.201.25@tcp:400: 00000100:00100000:2.0:1788666076.167257:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2361:x1875552173559552:12345-192.168.201.25@tcp:400: Request processed in 43us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666076.167264:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 129 00000100:00100000:0.0:1788666076.169132:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666076.169614:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666076.169692:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173559936 00000100:00100000:0.0:1788666076.169709:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173559936 00000100:00100000:0.0:1788666076.169767:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173559808 00000100:00100000:0.0:1788666076.169771:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173559808 00000100:00100000:0.0:1788666076.169790:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:0.0:1788666076.169798:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+5:2362:x1875552173559936:12345-192.168.201.25@tcp:400: 00000100:00100000:0.0:1788666076.169864:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+5:2362:x1875552173559936:12345-192.168.201.25@tcp:400: Request processed in 65us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666076.169871:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:0.0:1788666076.169887:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:0.0:1788666076.169907:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+5:2362:x1875552173559808:12345-192.168.201.25@tcp:400: 00000100:00100000:0.0:1788666076.169934:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+5:2362:x1875552173559808:12345-192.168.201.25@tcp:400: Request processed in 27us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666076.169940:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00080000:3.0:1788666076.170511:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788666076.170515:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788666076.176074:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788666076.302022:0:8258:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788666077.195576:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666077.578850:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788666077.578881:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186163456:0@lo:400: 00000100:00100000:2.0:1788666077.579096:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186163584:0@lo:400: 00000100:00100000:2.0:1788666077.579164:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666077.579327:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666077.579406:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3278:1875552186163968:0@lo:400: 00000100:00100000:1.0:1788666077.579436:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666077.579482:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186164096:0@lo:400: 00000100:00100000:2.0:1788666077.579515:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666077.579541:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788666077.579547:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3275:1875552186163712:0@lo:400: 00000100:00100000:2.0:1788666077.579569:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666077.579627:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186163584 00000100:00100000:2.0:1788666077.579635:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186163584 00000100:00100000:2.0:1788666077.579678:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186163968 00000100:00100000:2.0:1788666077.579681:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186163968 00000100:00100000:2.0:1788666077.579703:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186163712 00000100:00100000:2.0:1788666077.579706:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186163712 00000100:00100000:2.0:1788666077.579726:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788666077.579734:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186163584:12345-0@lo:400: 00000100:00100000:2.0:1788666077.579802:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186163584:12345-0@lo:400: Request processed in 68us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666077.579829:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788666077.579848:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788666077.579854:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875552186163968:12345-0@lo:400: 00000100:00100000:2.0:1788666077.579884:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875552186163968:12345-0@lo:400: Request processed in 30us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666077.579889:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788666077.579913:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788666077.579919:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1875552186163712:12345-0@lo:400: 00000100:00100000:2.0:1788666077.579947:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae840a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1875552186163712:12345-0@lo:400: Request processed in 29us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666077.579953:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788666077.579973:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186164096 00000100:00100000:2.0:1788666077.579976:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186164096 00000100:00100000:2.0:1788666077.580005:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788666077.580012:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186164096:12345-0@lo:400: 00000100:00100000:2.0:1788666077.580039:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186164096:12345-0@lo:400: Request processed in 29us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666077.580045:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788666077.580065:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788666077.580070:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666077.580103:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3275:1875552186163712:0@lo:400: 00000100:00100000:2.0:1788666077.580115:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186163584:0@lo:400: 00010000:00080000:2.0:1788666077.580127:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2ae840700 x1875552186164096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666077.580137:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae840700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186164096:0@lo:400: 00000100:00100000:3.0:1788666077.580299:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186163840:0@lo:400: 00000100:00100000:3.0:1788666077.580329:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666077.580409:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186163840 00000100:00100000:2.0:1788666077.580414:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186163840 00000100:00100000:2.0:1788666077.580453:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788666077.580460:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186163840:12345-0@lo:400: 00000100:00100000:2.0:1788666077.580498:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186163840:12345-0@lo:400: Request processed in 38us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666077.580504:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788666077.580532:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2ae840380 x1875552186163840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666093 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666077.580542:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae840380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186163840:0@lo:400: 00000100:00080000:3.0:1788666077.581833:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788666077.582891:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186163456 00000100:00100000:0.0:1788666077.582915:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186163456 00000100:00100000:0.0:1788666077.582968:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788666077.582980:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:3277:x1875552186163456:12345-0@lo:400: 00000100:00100000:0.0:1788666077.583090:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:3277:x1875552186163456:12345-0@lo:400: Request processed in 112us (3762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666077.583096:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788666077.583315:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186163456:0@lo:400: 00000100:00100000:1.0:1788666077.584476:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3278:1875552186163968:0@lo:400: 00000100:00100000:1.0:1788666078.094244:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788666078.094268:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186164224:0@lo:13: 00000100:00100000:1.0:1788666078.094347:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666078.094428:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186164224 00000100:00100000:1.0:1788666078.094438:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186164224 00000100:00100000:1.0:1788666078.094489:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788666078.094500:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186164224:12345-0@lo:13: 00002000:00000024:1.0:1788666078.094536:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666078.094598:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae725880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186164224:12345-0@lo:13: Request processed in 83us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666078.094605:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788666078.094801:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2ae727100 x1875552186164224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666078.094829:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae727100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186164224:0@lo:13: 00010000:00010000:3.0:1788666078.220162:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666079.117111:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186164352:0@lo:13: 00000100:00100000:2.0:1788666079.117205:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666079.117441:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186164352 00000100:00100000:0.0:1788666079.117451:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186164352 00000100:00100000:0.0:1788666079.117535:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788666079.117546:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186164352:12345-0@lo:13: 00002000:00000024:0.0:1788666079.117623:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666079.117674:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae840380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186164352:12345-0@lo:13: Request processed in 130us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666079.117681:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788666079.117741:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2988ffb80 x1875552186164352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666079.117759:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186164352:0@lo:13: 00000100:00080000:2.0:1788666079.117991:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788666079.245630:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788666079.815791:0:8405:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff28ed770 20000000:00000080:2.0:1788666079.816821:0:8405:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab286228400 uarg=0000000000000000 20000000:01000000:2.0:1788666079.816931:0:8405:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788666079.816934:0:8405:0:(mgs_llog.c:6068:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788666079.816937:0:8405:0:(mgs_llog.c:6099:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788666079.816943:0:8405:0:(mgs_llog.c:4747:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788666079.816950:0:8405:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788666079.816970:0:8405:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788666079.816973:0:8405:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788666079.819751:0:8405:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788666079.819759:0:8405:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788666079.822803:0:8406:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788666079.823485:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788666079.823571:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1788666079.823655:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1788666079.823670:0:8405:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788666079.823672:0:8405:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788666079.825281:0:8407:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788666079.827576:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788666079.828297:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788666079.828335:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1788666079.828363:0:8405:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788666079.828366:0:8405:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788666079.829650:0:8408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1788666079.830427:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1788666079.830475:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1788666079.830526:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1788666079.830540:0:8405:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788666079.830543:0:8405:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788666079.835899:0:8409:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788666079.839110:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788666079.839204:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788666079.839241:0:8405:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:2.0:1788666079.839272:0:8405:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788666079.839294:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab283fd4400/0x96bbe788361e99a1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.839314:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab280030400/0x96bbe788361e989e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9897 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.839323:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab280031400/0x96bbe788361e98c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e98c1 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.839330:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361e98f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e98eb expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.839336:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9900 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e98f9 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.839343:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab283fd4800/0x96bbe788361e990e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9907 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.839362:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab2a1d7ca00/0x96bbe788361e992a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9923 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.839368:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab280030600/0x96bbe788361e9954 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e994d expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.839377:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab283fd5400/0x96bbe788361e9962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42780 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.839384:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab283fd4600/0x96bbe788361e9969 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42787 expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.839391:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab283fd4400/0x96bbe788361e99a1 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.839446:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab283fd4600/0x96bbe788361e9969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42787 expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.839464:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab283fd4600/0x96bbe788361e9969 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42787 expref: 9 pid: 5800 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666079.839481:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae840700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8405:1875552186164480:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666079.840223:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab283fd5400/0x96bbe788361e9962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42780 expref: 9 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.840233:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab283fd5400/0x96bbe788361e9962 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42780 expref: 9 pid: 5801 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666079.840244:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae843480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8405:1875552186164608:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666079.840301:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab280030600/0x96bbe788361e9954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e994d expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.840309:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab280030600/0x96bbe788361e9954 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e994d expref: 18 pid: 5800 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666079.840318:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae843b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8405:1875552186164736:0@lo:104: 00000100:00100000:2.0:1788666079.840372:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788666079.840415:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab2a1d7ca00/0x96bbe788361e992a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e9923 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.840424:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab2a1d7ca00/0x96bbe788361e992a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e9923 expref: 18 pid: 5802 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666079.840448:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8405:1875552186164864:0@lo:104: 00000100:00100000:2.0:1788666079.840478:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788666079.840516:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab283fd4800/0x96bbe788361e990e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e9907 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.840525:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab283fd4800/0x96bbe788361e990e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e9907 expref: 18 pid: 5801 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666079.840533:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8405:1875552186164992:0@lo:104: 00010000:00010000:2.0:1788666079.840570:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e98f9 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.840597:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9900 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e98f9 expref: 18 pid: 5801 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666079.840606:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8405:1875552186165120:0@lo:104: 00010000:00010000:2.0:1788666079.840634:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361e98f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e98eb expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.840642:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361e98f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e98eb expref: 18 pid: 5802 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666079.840649:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8405:1875552186165248:0@lo:104: 00010000:00010000:2.0:1788666079.840671:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab280031400/0x96bbe788361e98c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e98c1 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.840679:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab280031400/0x96bbe788361e98c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e98c1 expref: 18 pid: 5802 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666079.840698:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8405:1875552186165376:0@lo:104: 00000100:00100000:1.0:1788666079.840849:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788666079.840881:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666079.840893:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666079.840900:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666079.840908:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186164736 00000100:00100000:1.0:1788666079.840914:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186164736 00000100:00100000:1.0:1788666079.840949:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186164864 00000100:00100000:1.0:1788666079.840951:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186164864 00000100:00100000:1.0:1788666079.840959:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186164992 00000100:00100000:1.0:1788666079.840961:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186164992 00000100:00100000:1.0:1788666079.840969:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186165120 00000100:00100000:1.0:1788666079.840971:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186165120 00000100:00100000:1.0:1788666079.840978:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186165248 00000100:00100000:1.0:1788666079.840980:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186165248 00000100:00100000:1.0:1788666079.841000:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788666079.841008:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+7:8405:x1875552186164736:12345-0@lo:104: 00010000:00010000:1.0:1788666079.841021:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c400/0x96bbe788361e994d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9954 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841068:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788666079.841074:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+7:8405:x1875552186164736:12345-0@lo:104: Request processed in 67us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666079.841080:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788666079.841097:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788666079.841103:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+6:8405:x1875552186164864:12345-0@lo:104: 00010000:00010000:1.0:1788666079.841110:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab280031800/0x96bbe788361e9923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e992a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841140:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788666079.841146:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3ed450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+6:8405:x1875552186164864:12345-0@lo:104: Request processed in 44us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666079.841152:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788666079.841185:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788666079.841191:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae727100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+5:8405:x1875552186164992:12345-0@lo:104: 00010000:00010000:1.0:1788666079.841198:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e990e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841228:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788666079.841232:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae727100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+5:8405:x1875552186164992:12345-0@lo:104: Request processed in 43us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666079.841238:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788666079.841250:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788666079.841262:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+4:8405:x1875552186165120:12345-0@lo:104: 00010000:00010000:1.0:1788666079.841269:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7ce00/0x96bbe788361e98f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841301:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788666079.841306:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae724700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+4:8405:x1875552186165120:12345-0@lo:104: Request processed in 46us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666079.841311:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788666079.841324:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788666079.841330:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae726a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+3:8405:x1875552186165248:12345-0@lo:104: 00010000:00010000:1.0:1788666079.841336:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4c00/0x96bbe788361e98eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e98f2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841372:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788666079.841377:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae726a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+3:8405:x1875552186165248:12345-0@lo:104: Request processed in 48us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666079.841382:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:1.0:1788666079.841400:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788666079.841406:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c400/0x96bbe788361e994d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9954 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841414:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7c400 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:1.0:1788666079.841418:0:5796:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c400/0x96bbe788361e994d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e9954 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841427:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c400/0x96bbe788361e994d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e9954 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666079.841433:0:5796:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c400/0x96bbe788361e994d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e9954 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666079.841445:0:5796:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788666079.841474:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c400/0x96bbe788361e994d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9954 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841480:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788666079.841498:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c400/0x96bbe788361e994d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9954 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841505:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7c400/0x96bbe788361e994d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9954 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841518:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788666079.841521:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab280031800/0x96bbe788361e9923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e992a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841526:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab280031800 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:1.0:1788666079.841529:0:5796:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab280031800/0x96bbe788361e9923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e992a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841535:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab280031800/0x96bbe788361e9923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e992a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666079.841540:0:5796:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab280031800/0x96bbe788361e9923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e992a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666079.841545:0:5796:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788666079.841556:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab280031800/0x96bbe788361e9923 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e992a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841562:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788666079.841608:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab280031800/0x96bbe788361e9923 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e992a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841616:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab280031800/0x96bbe788361e9923 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e992a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841626:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788666079.841629:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e990e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841635:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd5600 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:1.0:1788666079.841638:0:5796:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e990e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841645:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e990e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666079.841651:0:5796:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e990e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666079.841657:0:5796:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788666079.841668:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9907 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e990e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841674:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788666079.841678:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9907 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e990e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841684:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9907 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e990e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841692:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788666079.841712:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7ce00/0x96bbe788361e98f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841719:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7ce00 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:1.0:1788666079.841722:0:5796:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7ce00/0x96bbe788361e98f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e9900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841733:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7ce00/0x96bbe788361e98f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e9900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666079.841739:0:5796:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7ce00/0x96bbe788361e98f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e9900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666079.841744:0:5796:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788666079.841756:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7ce00/0x96bbe788361e98f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841761:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788666079.841766:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7ce00/0x96bbe788361e98f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841771:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7ce00/0x96bbe788361e98f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9900 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841779:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666079.841782:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4c00/0x96bbe788361e98eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e98f2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841787:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4c00 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:1.0:1788666079.841789:0:5796:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4c00/0x96bbe788361e98eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e98f2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841807:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4c00/0x96bbe788361e98eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e98f2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666079.841813:0:5796:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4c00/0x96bbe788361e98eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e98f2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666079.841818:0:5796:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788666079.841831:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4c00/0x96bbe788361e98eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e98f2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841837:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788666079.841842:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4c00/0x96bbe788361e98eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e98f2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841847:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4c00/0x96bbe788361e98eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e98f2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.841856:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666079.841858:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666079.841860:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666079.841868:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666079.841875:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666079.841881:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666079.841905:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186165504:0@lo:103: 00000100:00100000:1.0:1788666079.841946:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666079.841981:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186166016:0@lo:103: 00000100:00100000:1.0:1788666079.842002:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666079.842021:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788666079.842026:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186165888:0@lo:103: 00000100:00100000:1.0:1788666079.842050:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666079.842077:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186165632:0@lo:103: 00000100:00100000:1.0:1788666079.842096:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666079.842107:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788666079.842111:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186165760:0@lo:103: 00000100:00100000:1.0:1788666079.842131:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666079.842155:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186165504 00000100:00100000:1.0:1788666079.842161:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186165504 00010000:00010000:1.0:1788666079.842187:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab280030600/0x96bbe788361e9954 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e994d expref: 19 pid: 5800 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666079.842204:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186166016 00000100:00100000:1.0:1788666079.842206:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186166016 00010000:00010000:1.0:1788666079.842215:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361e98f2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e98eb expref: 20 pid: 5802 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666079.842222:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186165888 00000100:00100000:1.0:1788666079.842225:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186165888 00010000:00010000:1.0:1788666079.842233:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9900 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e98f9 expref: 21 pid: 5801 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666079.842243:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186165632 00000100:00100000:1.0:1788666079.842245:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186165632 00010000:00010000:1.0:1788666079.842255:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab2a1d7ca00/0x96bbe788361e992a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9923 expref: 22 pid: 5802 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666079.842265:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186165760 00000100:00100000:1.0:1788666079.842267:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186165760 00010000:00010000:1.0:1788666079.842277:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab283fd4800/0x96bbe788361e990e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9907 expref: 23 pid: 5801 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666079.842300:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788666079.842306:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae724e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+23:3278:x1875552186165504:12345-0@lo:103: 00010000:00010000:1.0:1788666079.842318:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666079.842323:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab280030600/0x96bbe788361e9954 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e994d expref: 23 pid: 5800 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.842334:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab280030600/0x96bbe788361e9954 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e994d expref: 23 pid: 5800 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.842360:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666079.842392:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae724e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+23:3278:x1875552186165504:12345-0@lo:103: Request processed in 86us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666079.842400:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788666079.842414:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788666079.842420:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+22:3278:x1875552186166016:12345-0@lo:103: 00010000:00010000:1.0:1788666079.842427:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666079.842431:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361e98f2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e98eb expref: 22 pid: 5802 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.842439:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361e98f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e98eb expref: 22 pid: 5802 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.842448:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666079.842468:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae727480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+22:3278:x1875552186166016:12345-0@lo:103: Request processed in 49us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666079.842473:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788666079.842484:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788666079.842496:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae725f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+21:3278:x1875552186165888:12345-0@lo:103: 00010000:00010000:1.0:1788666079.842503:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666079.842509:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9900 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e98f9 expref: 21 pid: 5801 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.842516:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9900 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e98f9 expref: 21 pid: 5801 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.842525:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666079.842545:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae725f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+21:3278:x1875552186165888:12345-0@lo:103: Request processed in 51us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666079.842551:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788666079.842563:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788666079.842567:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae726680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+20:3275:x1875552186165632:12345-0@lo:103: 00010000:00010000:1.0:1788666079.842574:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666079.842604:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab2a1d7ca00/0x96bbe788361e992a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9923 expref: 20 pid: 5802 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.842611:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab2a1d7ca00/0x96bbe788361e992a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e9923 expref: 20 pid: 5802 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.842619:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666079.842645:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae726680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+20:3275:x1875552186165632:12345-0@lo:103: Request processed in 78us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666079.842651:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788666079.842661:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788666079.842667:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186165760:12345-0@lo:103: 00010000:00010000:1.0:1788666079.842673:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666079.842683:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab283fd4800/0x96bbe788361e990e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9907 expref: 19 pid: 5801 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.842691:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab283fd4800/0x96bbe788361e990e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e9907 expref: 19 pid: 5801 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666079.842699:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666079.842719:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186165760:12345-0@lo:103: Request processed in 54us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666079.842724:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788666079.842764:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186165888:0@lo:103: 00000100:00100000:1.0:1788666079.842774:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae724a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186165504:0@lo:103: 00000100:00100000:1.0:1788666079.842781:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae724000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186166016:0@lo:103: 00000100:00100000:1.0:1788666079.842810:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae727b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186165760:0@lo:103: 00000100:00100000:1.0:1788666079.842817:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186165632:0@lo:103: 00000100:00100000:2.0:1788666079.845682:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788666079.846195:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab280030400/0x96bbe788361e989e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e9897 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.846213:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab280030400/0x96bbe788361e989e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e9897 expref: 18 pid: 5802 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666079.846229:0:8405:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8405:1875552186166144:0@lo:104: 00000100:00100000:2.0:1788666079.846260:0:8405:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666079.846292:0:8405:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2851be540 going to sleep for 11 seconds 00010000:00010000:2.0:1788666079.846323:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab280030600/0x96bbe788361e9954 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e994d expref: 18 pid: 5800 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666079.846338:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae843b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8405:1875552186164736:0@lo:104: 00010000:00010000:2.0:1788666079.846364:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2a1d7ca00/0x96bbe788361e992a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e9923 expref: 17 pid: 5802 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666079.846373:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8405:1875552186164864:0@lo:104: 00010000:00010000:2.0:1788666079.846384:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab283fd4800/0x96bbe788361e990e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e9907 expref: 16 pid: 5801 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666079.846393:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8405:1875552186164992:0@lo:104: 00010000:00010000:2.0:1788666079.846402:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9900 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e98f9 expref: 15 pid: 5801 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666079.846411:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8405:1875552186165120:0@lo:104: 00010000:00010000:2.0:1788666079.846439:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361e98f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e98eb expref: 14 pid: 5802 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666079.846447:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8405:1875552186165248:0@lo:104: 00000100:00100000:3.0:1788666079.846719:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186165376 00000100:00100000:3.0:1788666079.846726:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186165376 00000100:00100000:3.0:1788666079.846767:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186166144 00000100:00100000:3.0:1788666079.846770:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186166144 00000100:00100000:3.0:1788666079.846785:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788666079.846793:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:633727f4-1aad-4438-919b-34cfb144e459+4:8405:x1875552186165376:12345-0@lo:104: 00010000:00010000:3.0:1788666079.846807:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe800/0x96bbe788361e98c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e98c8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666079.846871:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788666079.846878:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:633727f4-1aad-4438-919b-34cfb144e459+4:8405:x1875552186165376:12345-0@lo:104: Request processed in 85us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666079.846885:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788666079.846902:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788666079.846909:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:633727f4-1aad-4438-919b-34cfb144e459+3:8405:x1875552186166144:12345-0@lo:104: 00010000:00010000:3.0:1788666079.846916:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e989e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666079.846946:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788666079.846950:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:633727f4-1aad-4438-919b-34cfb144e459+3:8405:x1875552186166144:12345-0@lo:104: Request processed in 43us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666079.846956:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788666079.847021:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666079.847102:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666079.847246:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae840700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8405:1875552186164480:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788666079.847257:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae843480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8405:1875552186164608:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788666079.847265:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8405:1875552186165376:0@lo:104: 00000100:00100000:2.0:1788666079.847272:0:8405:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8405:1875552186166144:0@lo:104: 00010000:00010000:2.0:1788666079.847314:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab283fd4400/0x96bbe788361e99a1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666079.847413:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173560192 00000100:00100000:3.0:1788666079.847418:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173560192 00010000:00010000:3.0:1788666079.847440:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab283fd5400/0x96bbe788361e9962 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42780 expref: 10 pid: 5801 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666079.847477:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173560064 00000100:00100000:3.0:1788666079.847480:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173560064 00010000:00010000:3.0:1788666079.847493:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab283fd4600/0x96bbe788361e9969 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42787 expref: 11 pid: 5800 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666079.847505:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:3.0:1788666079.847512:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17385a9f-d911-4baa-b21a-4b6dd266f57e+11:2364:x1875552173560192:12345-192.168.201.25@tcp:103: 00010000:00010000:3.0:1788666079.847524:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666079.847529:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab283fd5400/0x96bbe788361e9962 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42780 expref: 11 pid: 5801 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666079.847538:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab283fd5400/0x96bbe788361e9962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42780 expref: 11 pid: 5801 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666079.847554:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab283fd5400/0x96bbe788361e9962 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42780 expref: 11 pid: 5801 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666079.847566:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666079.847632:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2364:x1875552173560192:12345-192.168.201.25@tcp:103: Request processed in 120us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666079.847638:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:3.0:1788666079.847651:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:3.0:1788666079.847657:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b9dd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17385a9f-d911-4baa-b21a-4b6dd266f57e+9:2364:x1875552173560064:12345-192.168.201.25@tcp:103: 00010000:00010000:3.0:1788666079.847665:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666079.847669:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab283fd4600/0x96bbe788361e9969 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42787 expref: 9 pid: 5800 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666079.847689:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab283fd4600/0x96bbe788361e9969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42787 expref: 9 pid: 5800 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666079.847700:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab283fd4600/0x96bbe788361e9969 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42787 expref: 9 pid: 5800 timeout: 286 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666079.847709:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666079.847728:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b9dd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17385a9f-d911-4baa-b21a-4b6dd266f57e+8:2364:x1875552173560064:12345-192.168.201.25@tcp:103: Request processed in 72us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666079.847734:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 18 00010000:00010000:0.0:1788666079.848661:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788666079.848672:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe800/0x96bbe788361e98c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e98c8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666079.848682:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814fe800 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:0.0:1788666079.848687:0:5796:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe800/0x96bbe788361e98c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e98c8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666079.848696:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe800/0x96bbe788361e98c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e98c8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788666079.848704:0:5796:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe800/0x96bbe788361e98c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e98c8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666079.848710:0:5796:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788666079.848751:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe800/0x96bbe788361e98c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e98c8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666079.848758:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788666079.848789:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe800/0x96bbe788361e98c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e98c8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666079.848796:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe800/0x96bbe788361e98c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e98c8 expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666079.848808:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666079.848812:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e989e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666079.848818:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ffc00 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:0.0:1788666079.848821:0:5796:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e989e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666079.848829:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e989e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788666079.848835:0:5796:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e989e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666079.848841:0:5796:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788666079.848866:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9897 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e989e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666079.848872:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788666079.848878:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9897 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e989e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666079.848884:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9897 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e989e expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666079.848898:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666079.848904:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666079.848906:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666079.854735:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666079.856444:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186166272:0@lo:103: 00000100:00100000:1.0:1788666079.856534:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666079.856623:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788666079.856632:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186166400:0@lo:103: 00000100:00100000:1.0:1788666079.856655:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666079.856779:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186166272 00000100:00100000:2.0:1788666079.856788:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186166272 00010000:00010000:2.0:1788666079.856837:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab280031400/0x96bbe788361e98c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e98c1 expref: 14 pid: 5802 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666079.856872:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186166400 00000100:00100000:2.0:1788666079.856875:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186166400 00010000:00010000:2.0:1788666079.856886:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab280030400/0x96bbe788361e989e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9897 expref: 15 pid: 5802 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666079.856900:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788666079.856908:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae724380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:633727f4-1aad-4438-919b-34cfb144e459+15:3275:x1875552186166272:12345-0@lo:103: 00010000:00010000:2.0:1788666079.856923:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666079.856928:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab280031400/0x96bbe788361e98c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e98c1 expref: 15 pid: 5802 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.856939:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab280031400/0x96bbe788361e98c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e98c1 expref: 15 pid: 5802 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.856975:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab280031400/0x96bbe788361e98c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e98c1 expref: 15 pid: 5802 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.856991:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666079.857044:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae724380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:633727f4-1aad-4438-919b-34cfb144e459+14:3275:x1875552186166272:12345-0@lo:103: Request processed in 136us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666079.857051:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788666079.857067:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788666079.857073:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae727b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:633727f4-1aad-4438-919b-34cfb144e459+13:3275:x1875552186166400:12345-0@lo:103: 00010000:00010000:2.0:1788666079.857081:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666079.857085:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab280030400/0x96bbe788361e989e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9897 expref: 13 pid: 5802 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.857094:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab280030400/0x96bbe788361e989e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e9897 expref: 13 pid: 5802 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.857104:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab280030400/0x96bbe788361e989e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e9897 expref: 13 pid: 5802 timeout: 336 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.857115:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab283fd4400/0x96bbe788361e99a1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.857124:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab283fd4400/0x96bbe788361e99a1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.857139:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab283fd4400/0x96bbe788361e99a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.857147:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab283fd4400/0x96bbe788361e99a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.857159:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab283fd4400/0x96bbe788361e99a1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.857166:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab283fd4400/0x96bbe788361e99a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.857172:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4400 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666079.857176:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab283fd4400/0x96bbe788361e99a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.857184:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab283fd4400/0x96bbe788361e99a1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.857200:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab283fd4400/0x96bbe788361e99a1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.857210:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666079.857234:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae727b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:633727f4-1aad-4438-919b-34cfb144e459+12:3275:x1875552186166400:12345-0@lo:103: Request processed in 160us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666079.857240:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1788666079.857265:0:8405:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab283fd4400/0x96bbe788361e99a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.857272:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab283fd4400/0x96bbe788361e99a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666079.857278:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab283fd4400/0x96bbe788361e99a1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666079.858216:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186166400:0@lo:103: 00000100:00100000:0.0:1788666079.858230:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186166272:0@lo:103: 00010000:00010000:1.0:1788666080.266896:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666081.283508:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666081.283551:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666081.283623:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666081.283659:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666081.283735:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173560320 00000100:00100000:1.0:1788666081.283745:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173560320 00000100:00100000:1.0:1788666081.283802:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 131 00000100:00100000:1.0:1788666081.283832:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+8:2364:x1875552173560320:12345-192.168.201.25@tcp:400: 00000100:00100000:1.0:1788666081.283913:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+8:2364:x1875552173560320:12345-192.168.201.25@tcp:400: Request processed in 101us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666081.283921:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 131 00000100:00100000:3.0:1788666081.284306:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173560704 00000100:00100000:3.0:1788666081.284311:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173560704 00000100:00100000:3.0:1788666081.284361:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173560576 00000100:00100000:3.0:1788666081.284365:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173560576 00000100:00100000:3.0:1788666081.284382:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:3.0:1788666081.284394:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+5:2364:x1875552173560704:12345-192.168.201.25@tcp:400: 00000100:00100000:3.0:1788666081.284432:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+5:2364:x1875552173560704:12345-192.168.201.25@tcp:400: Request processed in 43us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666081.284439:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:3.0:1788666081.284452:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:3.0:1788666081.284458:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+5:2364:x1875552173560576:12345-192.168.201.25@tcp:400: 00000100:00100000:3.0:1788666081.284481:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+5:2364:x1875552173560576:12345-192.168.201.25@tcp:400: Request processed in 24us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666081.284487:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00080000:1.0:1788666081.284657:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788666081.284662:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788666081.285128:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173560448 00000100:00100000:2.0:1788666081.285528:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173560448 00000100:00100000:3.0:1788666081.285650:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:3.0:1788666081.285664:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173560448:12345-192.168.201.25@tcp:400: 00000100:00100000:3.0:1788666081.285754:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173560448:12345-192.168.201.25@tcp:400: Request processed in 95us (2256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666081.285774:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00080000:1.0:1788666081.289560:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788666081.291028:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788666081.419131:0:5804:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788666081.419140:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff8ab2bbf65000 from 39 10000000:01000000:2.0:1788666081.419146:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788666081.419199:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4400/0x96bbe788361e99a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.419211:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4400/0x96bbe788361e99a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.419222:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4400/0x96bbe788361e99a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666081.419249:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186166528:0@lo:101: 00000100:00100000:2.0:1788666081.419368:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666081.419443:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2988e9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788666081.423514:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186166528 00000100:00100000:0.0:1788666081.423530:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186166528 00000100:00100000:0.0:1788666081.423635:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788666081.423646:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+12:5804:x1875552186166528:12345-0@lo:101: 00010000:00010000:0.0:1788666081.423666:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666081.423687:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab280030600/0x96bbe788361e99af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e99a8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666081.423715:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab280030600/0x96bbe788361e99af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e99a8 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666081.423726:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab280030600/0x96bbe788361e99af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e99a8 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666081.423734:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab280030600, rc 0) 00000100:00100000:0.0:1788666081.423835:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+13:5804:x1875552186166528:12345-0@lo:101: Request processed in 191us (4468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666081.423842:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788666081.424357:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186166528:0@lo:101: 00010000:00010000:2.0:1788666081.424379:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4400/0x96bbe788361e99a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.424390:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4400/0x96bbe788361e99a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e99af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666081.424470:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186166656:0@lo:501: 00000100:00100000:2.0:1788666081.424509:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666081.424548:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2988e9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788666081.425001:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186166656 00000100:00100000:0.0:1788666081.425010:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186166656 00000100:00100000:0.0:1788666081.425073:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788666081.425081:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+13:5804:x1875552186166656:12345-0@lo:501: 00000100:00100000:0.0:1788666081.425374:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+13:5804:x1875552186166656:12345-0@lo:501: Request processed in 294us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666081.425382:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788666081.425533:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186166656:0@lo:501: 00000100:00100000:1.0:1788666081.425571:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae724000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186166784:0@lo:503: 00000100:00100000:1.0:1788666081.425644:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666081.425679:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788666081.425742:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186166784 00000100:00100000:3.0:1788666081.425747:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186166784 00000100:00100000:3.0:1788666081.425793:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788666081.425801:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+13:5804:x1875552186166784:12345-0@lo:503: 00000100:00100000:3.0:1788666081.425966:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+13:5804:x1875552186166784:12345-0@lo:503: Request processed in 166us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666081.425973:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788666081.426124:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae724000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186166784:0@lo:503: 00000100:00100000:1.0:1788666081.427401:0:8422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae724000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8422:1875552186166912:0@lo:502: 00000100:00100000:1.0:1788666081.427475:0:8422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666081.427513:0:8422:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788666081.427572:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186166912 00000100:00100000:3.0:1788666081.427605:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186166912 00000100:00100000:3.0:1788666081.427651:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788666081.427660:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+13:8422:x1875552186166912:12345-0@lo:502: 00000100:00100000:3.0:1788666081.427919:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+13:8422:x1875552186166912:12345-0@lo:502: Request processed in 259us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666081.427926:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788666081.428148:0:8422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae724000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8422:1875552186166912:0@lo:502: 00000100:00100000:1.0:1788666081.428196:0:8422:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae724000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8422:1875552186167040:0@lo:502: 00000100:00100000:1.0:1788666081.428232:0:8422:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666081.428262:0:8422:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788666081.428550:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186167040 00000100:00100000:2.0:1788666081.428557:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186167040 00000100:00100000:2.0:1788666081.428615:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788666081.428623:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+13:8422:x1875552186167040:12345-0@lo:502: 00000100:00100000:2.0:1788666081.428814:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+13:8422:x1875552186167040:12345-0@lo:502: Request processed in 192us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666081.428822:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788666081.428982:0:8422:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae724000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8422:1875552186167040:0@lo:502: 00000040:00080000:1.0:1788666081.429003:0:8422:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788666081.429226:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788666081.429253:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788666081.429264:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4400/0x96bbe788361e99a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.429275:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4400/0x96bbe788361e99a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666081.429284:0:5804:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788666081.429287:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788666081.429290:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788666081.429318:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e99b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.429335:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e99b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.429345:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e99b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666081.429361:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186167168:0@lo:101: 00000100:00100000:2.0:1788666081.429396:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666081.429430:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2988e9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788666081.429488:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186167168 00000100:00100000:0.0:1788666081.429493:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186167168 00000100:00100000:0.0:1788666081.429531:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788666081.429539:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+13:5804:x1875552186167168:12345-0@lo:101: 00010000:00010000:0.0:1788666081.429549:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666081.429561:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab280031800/0x96bbe788361e99bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e99b6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666081.429611:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab280031800/0x96bbe788361e99bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e99b6 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666081.429622:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab280031800/0x96bbe788361e99bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e99b6 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666081.429630:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab280031800, rc 0) 00000100:00100000:0.0:1788666081.429669:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+14:5804:x1875552186167168:12345-0@lo:101: Request processed in 131us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666081.429674:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788666081.429746:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186167168:0@lo:101: 00010000:00010000:2.0:1788666081.429760:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e99b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.429897:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e99b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e99bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666081.429942:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186167296:0@lo:501: 00000100:00100000:2.0:1788666081.429966:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666081.429993:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2988e9000 going to sleep for 11 seconds 00000100:00100000:1.0:1788666081.430063:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186167296 00000100:00100000:1.0:1788666081.430068:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186167296 00000100:00100000:1.0:1788666081.430100:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788666081.430117:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298878850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+14:5804:x1875552186167296:12345-0@lo:501: 00000100:00100000:1.0:1788666081.430357:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298878850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+14:5804:x1875552186167296:12345-0@lo:501: Request processed in 250us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666081.430364:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788666081.430574:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186167296:0@lo:501: 00000100:00100000:2.0:1788666081.440808:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186167424:0@lo:503: 00000100:00100000:2.0:1788666081.440909:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666081.440990:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2988e9000 going to sleep for 11 seconds 00000100:00100000:1.0:1788666081.442346:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186167424 00000100:00100000:1.0:1788666081.442362:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186167424 00000100:00100000:1.0:1788666081.442422:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788666081.442433:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+14:5804:x1875552186167424:12345-0@lo:503: 00000100:00100000:1.0:1788666081.442693:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+14:5804:x1875552186167424:12345-0@lo:503: Request processed in 261us (1783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666081.442702:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788666081.442743:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186167424:0@lo:503: 00000100:00100000:1.0:1788666081.444614:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae724000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8423:1875552186167552:0@lo:502: 00000100:00100000:1.0:1788666081.444691:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666081.444737:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788666081.444799:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186167552 00000100:00100000:0.0:1788666081.444807:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186167552 00000100:00100000:0.0:1788666081.444848:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788666081.444856:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+14:8423:x1875552186167552:12345-0@lo:502: 00000100:00100000:0.0:1788666081.445344:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+14:8423:x1875552186167552:12345-0@lo:502: Request processed in 487us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666081.445359:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788666081.447467:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae724000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8423:1875552186167552:0@lo:502: 00000020:01000000:1.0:1788666081.447521:0:8423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788666081.447533:0:8423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666081.447536:0:8423:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788666081.447543:0:8423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788666081.447598:0:8423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae724000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8423:1875552186167680:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788666081.447675:0:8423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666081.447730:0:8423:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788666081.447810:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186167680 00000100:00100000:0.0:1788666081.447818:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186167680 00000100:00100000:0.0:1788666081.447874:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788666081.447887:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+14:8423:x1875552186167680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788666081.448207:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+14:8423:x1875552186167680:12345-0@lo:502:llog_process_th.0 Request processed in 322us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666081.448216:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788666081.449503:0:8423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae724000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8423:1875552186167680:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788666081.449547:0:8423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788666081.449556:0:8423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666081.449558:0:8423:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788666081.449562:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788666081.449719:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788666081.449744:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788666081.449759:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e99b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.449925:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e99b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666081.450010:0:5804:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788666081.450014:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff8ab2bcd59800 from 39 10000000:01000000:3.0:1788666081.450017:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788666081.450058:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe000/0x96bbe788361e99c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666081.450066:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe000/0x96bbe788361e99c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666081.450075:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe000/0x96bbe788361e99c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666081.450171:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186167808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788666081.450227:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666081.450310:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bc3b0cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788666081.450363:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186167808 00000100:00100000:0.0:1788666081.450369:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186167808 00000100:00100000:0.0:1788666081.450451:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788666081.450461:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+14:5804:x1875552186167808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788666081.450476:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666081.450488:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab280031200/0x96bbe788361e99cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e99c4 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666081.450513:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab280031200/0x96bbe788361e99cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e99c4 expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666081.450524:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab280031200/0x96bbe788361e99cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e99c4 expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666081.450533:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab280031200, rc 0) 00000100:00100000:0.0:1788666081.450659:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+15:5804:x1875552186167808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666081.450665:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788666081.450788:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186167808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788666081.450802:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe000/0x96bbe788361e99c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.450821:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe000/0x96bbe788361e99c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e99cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666081.450937:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186167936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788666081.450964:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666081.450996:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bc3b00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666081.451092:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186167936 00000100:00100000:2.0:1788666081.451097:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186167936 00000100:00100000:2.0:1788666081.451175:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788666081.451183:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+15:5804:x1875552186167936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788666081.451446:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+15:5804:x1875552186167936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666081.451454:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788666081.451688:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186167936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788666081.451719:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186168064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788666081.451758:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666081.452388:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bc3b00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666081.452450:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186168064 00000100:00100000:2.0:1788666081.452457:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186168064 00000100:00100000:3.0:1788666081.452681:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788666081.452691:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+15:5804:x1875552186168064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788666081.452904:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+15:5804:x1875552186168064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 215us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666081.452912:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788666081.453145:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186168064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788666081.453412:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8424:1875552186168192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788666081.453458:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666081.454638:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2988e9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788666081.455272:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186168192 00000100:00100000:0.0:1788666081.455296:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186168192 00000100:00100000:0.0:1788666081.455351:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788666081.455360:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+15:8424:x1875552186168192:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788666081.455643:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+15:8424:x1875552186168192:12345-0@lo:502:llog_process_th.0 Request processed in 284us (2184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666081.455651:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788666081.455762:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8424:1875552186168192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788666081.455837:0:8424:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8424:1875552186168320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788666081.455878:0:8424:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666081.455907:0:8424:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2905866c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788666081.456036:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186168320 00000100:00100000:0.0:1788666081.456042:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186168320 00000100:00100000:0.0:1788666081.456060:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788666081.456066:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298878450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+15:8424:x1875552186168320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788666081.456226:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298878450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+15:8424:x1875552186168320:12345-0@lo:502:llog_process_th.0 Request processed in 159us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666081.456233:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788666081.457296:0:8424:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8424:1875552186168320:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788666081.457343:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788666081.457543:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788666081.457569:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788666081.457598:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe000/0x96bbe788361e99c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666081.457610:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe000/0x96bbe788361e99c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666081.457619:0:5804:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788666081.457621:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788666081.457624:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788666081.457658:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e99d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666081.457667:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e99d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666081.457687:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e99d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666081.457705:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186168448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788666081.457754:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666081.457786:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab286555c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666081.457868:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186168448 00000100:00100000:2.0:1788666081.457874:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186168448 00000100:00100000:2.0:1788666081.457905:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788666081.457913:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+15:5804:x1875552186168448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788666081.457934:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666081.457948:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab283fd4800/0x96bbe788361e99d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e99d2 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.457970:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab283fd4800/0x96bbe788361e99d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e99d2 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.457980:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab283fd4800/0x96bbe788361e99d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e99d2 expref: 16 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.457989:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd4800, rc 0) 00000100:00100000:2.0:1788666081.458027:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+16:5804:x1875552186168448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666081.458033:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788666081.460289:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186168448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788666081.460331:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e99d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99d9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666081.460345:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e99d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e99d9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666081.460428:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186168576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666081.460492:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666081.460532:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab286555c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666081.460736:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186168576 00000100:00100000:2.0:1788666081.460742:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186168576 00000100:00100000:2.0:1788666081.460779:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788666081.460788:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298878c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+16:5804:x1875552186168576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788666081.461064:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298878c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+16:5804:x1875552186168576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 276us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666081.461072:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788666081.462667:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988ff480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186168576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788666081.462729:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186168704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788666081.462803:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666081.462844:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bc3b00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666081.462929:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186168704 00000100:00100000:2.0:1788666081.462936:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186168704 00000100:00100000:2.0:1788666081.462978:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788666081.462986:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+16:5804:x1875552186168704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788666081.463196:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+16:5804:x1875552186168704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 210us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666081.463214:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788666081.463365:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186168704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788666081.463904:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8425:1875552186168832:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788666081.463946:0:8425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666081.463986:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bc3b0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788666081.464031:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186168832 00000100:00100000:2.0:1788666081.464038:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186168832 00000100:00100000:2.0:1788666081.464070:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788666081.464078:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+16:8425:x1875552186168832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788666081.464252:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+16:8425:x1875552186168832:12345-0@lo:502:llog_process_th.0 Request processed in 175us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666081.464260:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788666081.464386:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8425:1875552186168832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788666081.464416:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788666081.464426:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666081.464428:0:8425:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788666081.464434:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788666081.464457:0:8425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae724000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8425:1875552186168960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788666081.464492:0:8425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666081.464517:0:8425:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788666081.464569:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186168960 00000100:00100000:3.0:1788666081.464574:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186168960 00000100:00100000:3.0:1788666081.464631:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788666081.464638:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298878050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+16:8425:x1875552186168960:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788666081.464786:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298878050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+16:8425:x1875552186168960:12345-0@lo:502:llog_process_th.0 Request processed in 148us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666081.464794:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788666081.465066:0:8425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae724000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8425:1875552186168960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788666081.465089:0:8425:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788666081.465094:0:8425:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666081.465096:0:8425:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788666081.465100:0:8425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1788666081.465310:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788666081.465340:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788666081.465349:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e99d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99d9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.465360:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e99d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99d9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666081.465371:0:5804:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788666081.465373:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff8ab290a54800 from 39 10000000:01000000:2.0:1788666081.465376:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788666081.465408:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4e00/0x96bbe788361e99e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.465417:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4e00/0x96bbe788361e99e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.465427:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4e00/0x96bbe788361e99e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666081.465443:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186169088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788666081.465490:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666081.465522:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab290586780 going to sleep for 11 seconds 00000100:00100000:2.0:1788666081.465539:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186169088 00000100:00100000:2.0:1788666081.465544:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186169088 00000100:00100000:2.0:1788666081.465575:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788666081.465602:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+16:5804:x1875552186169088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788666081.465613:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666081.465626:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab283fd4600/0x96bbe788361e99e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e99e0 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.465648:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab283fd4600/0x96bbe788361e99e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e99e0 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.465658:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab283fd4600/0x96bbe788361e99e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e99e0 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.465666:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd4600, rc 0) 00000100:00100000:2.0:1788666081.465695:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186169088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666081.465701:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788666081.465731:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186169088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788666081.465745:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4e00/0x96bbe788361e99e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99e7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.465754:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4e00/0x96bbe788361e99e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e99e7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666081.465796:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186169216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788666081.465830:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666081.465843:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab290586780 going to sleep for 11 seconds 00000100:00100000:2.0:1788666081.465854:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186169216 00000100:00100000:2.0:1788666081.465857:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186169216 00000100:00100000:2.0:1788666081.465875:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788666081.465881:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186169216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788666081.466890:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186169216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1004us (1055us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666081.466900:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788666081.467064:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186169216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788666081.467095:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186169344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788666081.467141:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666081.467171:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bc3b0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788666081.467258:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186169344 00000100:00100000:1.0:1788666081.467264:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186169344 00000100:00100000:1.0:1788666081.467297:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788666081.467303:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186169344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788666081.467492:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186169344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666081.467498:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788666081.467754:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186169344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788666081.468114:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8426:1875552186169472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788666081.468154:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666081.468183:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bc3b0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788666081.468388:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186169472 00000100:00100000:2.0:1788666081.468394:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186169472 00000100:00100000:2.0:1788666081.468431:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788666081.468439:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+17:8426:x1875552186169472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788666081.468660:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+17:8426:x1875552186169472:12345-0@lo:502:llog_process_th.0 Request processed in 221us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666081.468667:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788666081.468796:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8426:1875552186169472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788666081.468837:0:8426:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8426:1875552186169600:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788666081.468872:0:8426:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666081.468899:0:8426:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bc3b0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788666081.468940:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186169600 00000100:00100000:2.0:1788666081.468945:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186169600 00000100:00100000:2.0:1788666081.468977:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788666081.468984:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+17:8426:x1875552186169600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788666081.469238:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+17:8426:x1875552186169600:12345-0@lo:502:llog_process_th.0 Request processed in 254us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666081.469244:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788666081.469359:0:8426:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8426:1875552186169600:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788666081.469378:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788666081.469540:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788666081.469557:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788666081.469566:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4e00/0x96bbe788361e99e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99e7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.469826:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4e00/0x96bbe788361e99e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99e7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666081.469933:0:5804:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788666081.469937:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788666081.469946:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788666081.469974:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e99ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666081.469983:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e99ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666081.469992:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e99ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666081.470007:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186169728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788666081.470041:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666081.470101:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bc3b0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788666081.470192:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186169728 00000100:00100000:1.0:1788666081.470198:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186169728 00000100:00100000:1.0:1788666081.470266:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788666081.470274:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186169728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788666081.470285:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666081.470298:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2a1d7d000/0x96bbe788361e99f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e99ee expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666081.470319:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2a1d7d000/0x96bbe788361e99f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e99ee expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666081.470348:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2a1d7d000/0x96bbe788361e99f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e99ee expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666081.470356:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2a1d7d000, rc 0) 00000100:00100000:1.0:1788666081.470397:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186169728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666081.470404:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788666081.470459:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186169728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666081.470472:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e99ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666081.470481:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e99ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e99f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666081.470526:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186169856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788666081.470548:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666081.470748:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bc3b0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788666081.470814:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186169856 00000100:00100000:2.0:1788666081.470818:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186169856 00000100:00100000:2.0:1788666081.470839:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788666081.470846:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186169856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788666081.471176:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186169856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 329us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666081.471183:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788666081.471289:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186169856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788666081.471319:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186169984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788666081.472927:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666081.473097:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bc3b0d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788666081.473247:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186169984 00000100:00100000:2.0:1788666081.473255:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186169984 00000100:00100000:2.0:1788666081.473346:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788666081.473357:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186169984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788666081.473569:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186169984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666081.473576:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788666081.473700:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186169984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788666081.474310:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8427:1875552186170112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788666081.474367:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666081.474819:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bc3b06c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666081.474884:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186170112 00000100:00100000:1.0:1788666081.474891:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186170112 00000100:00100000:1.0:1788666081.474925:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788666081.474933:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+18:8427:x1875552186170112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788666081.475259:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+18:8427:x1875552186170112:12345-0@lo:502:llog_process_th.0 Request processed in 326us (891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666081.475268:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788666081.475362:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8427:1875552186170112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788666081.475392:0:8427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666081.475401:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666081.475404:0:8427:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788666081.475410:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788666081.475436:0:8427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8427:1875552186170240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788666081.475472:0:8427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666081.475764:0:8427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bc3b06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666081.475844:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186170240 00000100:00100000:2.0:1788666081.475851:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186170240 00000100:00100000:2.0:1788666081.475879:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788666081.475887:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+18:8427:x1875552186170240:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788666081.476315:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+18:8427:x1875552186170240:12345-0@lo:502:llog_process_th.0 Request processed in 427us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666081.476333:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788666081.476426:0:8427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8427:1875552186170240:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788666081.476450:0:8427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666081.476454:0:8427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666081.476456:0:8427:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788666081.476460:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788666081.476779:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788666081.476797:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788666081.476810:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e99ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666081.476820:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e99ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666081.476830:0:5804:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788666081.476833:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-sptlrpc-ffff8ab2989a4d40 from 1 10000000:01000000:0.0:1788666081.476836:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788666081.476873:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab280031400/0x96bbe788361e99fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666081.476881:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab280031400/0x96bbe788361e99fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666081.476890:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab280031400/0x96bbe788361e99fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666081.476907:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186170368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788666081.476945:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666081.477018:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab286555c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666081.477057:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186170368 00000100:00100000:2.0:1788666081.477069:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186170368 00000100:00100000:2.0:1788666081.477228:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788666081.477238:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186170368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788666081.477249:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666081.477260:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab283fd5400/0x96bbe788361e9a03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e99fc expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.477282:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab283fd5400/0x96bbe788361e9a03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e99fc expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.477291:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab283fd5400/0x96bbe788361e9a03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e99fc expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666081.477299:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd5400, rc 0) 00000100:00100000:2.0:1788666081.477350:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:5804:x1875552186170368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666081.477356:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788666081.477415:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186170368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788666081.477427:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab280031400/0x96bbe788361e99fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9a03 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666081.477436:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab280031400/0x96bbe788361e99fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9a03 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666081.477482:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186170496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666081.477506:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666081.477573:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab286555c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788666081.477679:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186170496 00000100:00100000:1.0:1788666081.477684:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186170496 00000100:00100000:1.0:1788666081.477705:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788666081.477711:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:5804:x1875552186170496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788666081.477941:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:5804:x1875552186170496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (432us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788666081.477948:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788666081.478026:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186170496:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788666081.478050:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788666081.478056:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab280031400/0x96bbe788361e99fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9a03 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666081.478064:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab280031400/0x96bbe788361e99fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9a03 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666082.315531:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666082.699259:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186170624:0@lo:400:kworker.0 00000100:00100000:1.0:1788666082.699373:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666082.699432:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3277:1875552186171136:0@lo:400:kworker.0 00000100:00100000:1.0:1788666082.699461:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666082.699504:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788666082.699510:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186170752:0@lo:400:kworker.0 00000100:00100000:1.0:1788666082.699532:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666082.699547:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186171264:0@lo:400:kworker.0 00000100:00100000:1.0:1788666082.699608:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666082.699637:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186171008:0@lo:400:kworker.0 00000100:00100000:0.0:1788666082.699711:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3275:1875552186170880:0@lo:400:kworker.0 00000100:00100000:0.0:1788666082.699741:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666082.699744:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666082.699776:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186170752 00000100:00100000:0.0:1788666082.699776:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186171136 00000100:00100000:1.0:1788666082.699783:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186170752 00000100:00100000:0.0:1788666082.699783:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186171136 00000100:00100000:1.0:1788666082.699823:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186170880 00000100:00100000:1.0:1788666082.699827:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186170880 00000100:00100000:0.0:1788666082.699831:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788666082.699839:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186170752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666082.699840:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788666082.699845:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875552186171136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666082.699892:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186170752:12345-0@lo:400:kworker.0 Request processed in 54us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666082.699899:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788666082.699916:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788666082.699922:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1875552186170880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666082.699953:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1875552186170880:12345-0@lo:400:kworker.0 Request processed in 31us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666082.699959:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788666082.699960:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666082.699974:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186171264 00000100:00100000:2.0:1788666082.699978:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186171264 00000100:00100000:2.0:1788666082.700010:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186171008 00000100:00100000:2.0:1788666082.700013:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186171008 00000100:00100000:2.0:1788666082.700029:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788666082.700035:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186171264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666082.700232:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186170624 00000100:00100000:3.0:1788666082.700236:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186170624 00000100:00100000:0.0:1788666082.700265:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3275:1875552186170880:0@lo:400:kworker.0 00000100:00100000:3.0:1788666082.700267:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788666082.700274:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:3277:x1875552186170624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666082.700333:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae724000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875552186171136:12345-0@lo:400:kworker.0 Request processed in 486us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666082.700340:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788666082.700368:0:6650:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788666082.700375:0:6650:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788666082.700389:0:6649:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788666082.700395:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788666082.700401:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186171008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666082.700434:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186171008:12345-0@lo:400:kworker.0 Request processed in 33us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666082.700439:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788666082.700466:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2aea3c380 x1875552186171008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666082.700477:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186171008:0@lo:400:kworker.0 00000100:00080000:1.0:1788666082.700509:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788666082.700512:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788666082.700807:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186171264:12345-0@lo:400:kworker.0 Request processed in 770us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666082.700815:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788666082.706176:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186170752:0@lo:400:kworker.0 00010000:00080000:0.0:1788666082.706208:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2aea3dc00 x1875552186171264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666098 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666082.706220:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186171264:0@lo:400:kworker.0 00000100:00100000:3.0:1788666082.709068:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:3277:x1875552186170624:12345-0@lo:400:kworker.0 Request processed in 8782us (9683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666082.709083:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788666082.713377:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186170624:0@lo:400:kworker.0 00000100:00100000:0.0:1788666082.713404:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3277:1875552186171136:0@lo:400:kworker.0 00000100:00100000:2.0:1788666083.211373:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788666083.211396:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186171392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788666083.211476:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666083.211543:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186171392 00000100:00100000:1.0:1788666083.211561:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186171392 00000100:00100000:1.0:1788666083.211633:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788666083.211644:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186171392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788666083.211869:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666083.211919:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186171392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 276us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666083.211926:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788666083.212787:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2ae724e00 x1875552186171392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666083.212811:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186171392:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788666083.338716:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666084.234852:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788666084.234886:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186171520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788666084.234963:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666084.235341:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186171520 00000100:00100000:0.0:1788666084.235351:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186171520 00000100:00100000:0.0:1788666084.235421:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788666084.235431:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186171520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788666084.235468:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666084.235536:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae727480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186171520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666084.235544:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788666084.235617:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2988fe680 x1875552186171520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788666084.235725:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788666084.235850:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186171520:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788666084.362753:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666085.378710:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666085.378883:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173560832 00000100:00100000:0.0:1788666085.378895:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173560832 00000100:00100000:0.0:1788666085.378954:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 165 00000100:00100000:0.0:1788666085.378964:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+8:5603:x1875552173560832:12345-192.168.201.25@tcp:101: 00010000:00010000:0.0:1788666085.378981:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666085.379000:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab280030e00/0x96bbe788361e9a0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d427e9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666085.379030:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab280030e00/0x96bbe788361e9a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427e9 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666085.379043:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab280030e00/0x96bbe788361e9a0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427e9 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666085.379052:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab280030e00, rc 0) 00000100:00100000:0.0:1788666085.379120:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+9:5603:x1875552173560832:12345-192.168.201.25@tcp:101: Request processed in 157us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666085.379127:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 165 00000100:00100000:0.0:1788666085.380653:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666085.384568:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173560960 00000100:00100000:3.0:1788666085.384596:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173560960 00000100:00100000:3.0:1788666085.384667:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 166 00000100:00100000:3.0:1788666085.384690:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+9:5603:x1875552173560960:12345-192.168.201.25@tcp:501: 00000100:00100000:3.0:1788666085.385156:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+9:5603:x1875552173560960:12345-192.168.201.25@tcp:501: Request processed in 466us (4507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666085.385165:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 166 00010000:00010000:1.0:1788666085.386817:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666085.390188:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666085.391818:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173561088 00000100:00100000:1.0:1788666085.391833:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173561088 00000100:00100000:1.0:1788666085.391968:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 167 00000100:00100000:1.0:1788666085.391981:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+9:5603:x1875552173561088:12345-192.168.201.25@tcp:503: 00000100:00100000:1.0:1788666085.392268:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+9:5603:x1875552173561088:12345-192.168.201.25@tcp:503: Request processed in 289us (2090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666085.392277:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 167 00000100:00100000:1.0:1788666085.396667:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666085.396763:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173561216 00000100:00100000:3.0:1788666085.396774:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173561216 00000100:00100000:3.0:1788666085.396835:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 168 00000100:00100000:3.0:1788666085.396844:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+9:6099:x1875552173561216:12345-192.168.201.25@tcp:502: 00000100:00100000:3.0:1788666085.397113:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+9:6099:x1875552173561216:12345-192.168.201.25@tcp:502: Request processed in 268us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666085.397131:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 168 00000100:00100000:2.0:1788666085.402993:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666085.403111:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173561344 00000100:00100000:1.0:1788666085.403140:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173561344 00000100:00100000:1.0:1788666085.403331:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 169 00000100:00100000:1.0:1788666085.403342:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+9:6099:x1875552173561344:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788666085.403725:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+9:6099:x1875552173561344:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 383us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666085.403734:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 169 00000100:00100000:2.0:1788666085.407424:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666085.407763:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173561472 00000100:00100000:0.0:1788666085.407789:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173561472 00000100:00100000:0.0:1788666085.407844:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 170 00000100:00100000:0.0:1788666085.407854:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+9:5603:x1875552173561472:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788666085.407874:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666085.407893:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab280030400/0x96bbe788361e9a11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d427f0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666085.407923:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab280030400/0x96bbe788361e9a11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427f0 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666085.407935:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab280030400/0x96bbe788361e9a11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427f0 expref: 10 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666085.407945:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab280030400, rc 0) 00000100:00100000:0.0:1788666085.408021:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:5603:x1875552173561472:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 168us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666085.408029:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 170 00000100:00100000:0.0:1788666085.411016:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666085.413024:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173561600 00000100:00100000:3.0:1788666085.413042:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173561600 00000100:00100000:3.0:1788666085.413113:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 171 00000100:00100000:3.0:1788666085.413124:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:5603:x1875552173561600:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788666085.413896:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:5603:x1875552173561600:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 768us (2885us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788666085.413907:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 171 00000020:00000080:1.0:1788666086.160570:0:8467:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff34625020 20000000:00000080:1.0:1788666086.160613:0:8467:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab2856a4800 uarg=0000000000000000 20000000:01000000:1.0:1788666086.160653:0:8467:0:(mgs_llog.c:6191:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788666086.160659:0:8467:0:(mgs_llog.c:4646:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788666086.160663:0:8467:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788666086.163030:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1788666086.164134:0:8467:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788666086.170351:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788666086.170399:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788666086.170450:0:8467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788666086.170470:0:8467:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788666086.170492:0:8467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab28144a600/0x96bbe788361e9a18 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.170572:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab283fd5200/0x96bbe788361e97e1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e97da expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.170834:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab2814ff200/0x96bbe788361e9858 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9851 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.171069:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab283fd5e00/0x96bbe788361e98ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e98b3 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.171080:0:8467:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361e9977 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427b8 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.171088:0:8467:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab28144a600/0x96bbe788361e9a18 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666086.171226:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361e9977 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427b8 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666086.171254:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361e9977 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427b8 expref: 9 pid: 5802 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666086.171272:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae725f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875552186171648:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788666086.171422:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab283fd5e00/0x96bbe788361e98ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e98b3 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666086.171431:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab283fd5e00/0x96bbe788361e98ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e98b3 expref: 18 pid: 5800 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666086.171441:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae726680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875552186171776:0@lo:104: 00000100:00100000:1.0:1788666086.171490:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788666086.171531:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab2814ff200/0x96bbe788361e9858 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e9851 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666086.171547:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab2814ff200/0x96bbe788361e9858 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e9851 expref: 18 pid: 5801 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666086.171556:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae724e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875552186171904:0@lo:104: 00000100:00100000:1.0:1788666086.171621:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788666086.171649:0:8467:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab283fd5200/0x96bbe788361e97e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e97da expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666086.171657:0:8467:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab283fd5200/0x96bbe788361e97e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e97da expref: 18 pid: 5802 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666086.171665:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae843480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875552186172032:0@lo:104: 00000100:00100000:1.0:1788666086.171685:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28a924300 going to sleep for 11 seconds 00000100:00100000:0.0:1788666086.171755:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788666086.171773:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666086.171784:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186171776 00000100:00100000:0.0:1788666086.171791:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186171776 00000100:00100000:0.0:1788666086.171824:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186171904 00000100:00100000:0.0:1788666086.171826:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186171904 00000100:00100000:0.0:1788666086.171834:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186172032 00000100:00100000:0.0:1788666086.171836:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186172032 00000100:00100000:0.0:1788666086.171848:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788666086.171856:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+5:8467:x1875552186171776:12345-0@lo:104: 00010000:00010000:0.0:1788666086.171868:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe200/0x96bbe788361e98b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e98ba expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.171922:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788666086.171928:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+5:8467:x1875552186171776:12345-0@lo:104: Request processed in 73us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666086.171935:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788666086.171950:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788666086.171955:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab182620c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+4:8467:x1875552186171904:12345-0@lo:104: 00010000:00010000:0.0:1788666086.171970:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff800/0x96bbe788361e9851 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9858 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172012:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788666086.172018:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab182620c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+4:8467:x1875552186171904:12345-0@lo:104: Request processed in 63us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666086.172024:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788666086.172055:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788666086.172060:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+3:8467:x1875552186172032:12345-0@lo:104: 00010000:00010000:0.0:1788666086.172068:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe400/0x96bbe788361e97da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e97e1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172099:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788666086.172104:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+3:8467:x1875552186172032:12345-0@lo:104: Request processed in 44us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666086.172109:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788666086.172125:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788666086.172131:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe200/0x96bbe788361e98b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e98ba expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172139:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814fe200 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:0.0:1788666086.172143:0:5796:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe200/0x96bbe788361e98b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e98ba expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172152:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe200/0x96bbe788361e98b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e98ba expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788666086.172160:0:5796:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe200/0x96bbe788361e98b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e98ba expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666086.172172:0:5796:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788666086.172198:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe200/0x96bbe788361e98b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e98ba expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172205:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788666086.172228:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe200/0x96bbe788361e98b3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e98ba expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172236:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe200/0x96bbe788361e98b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e98ba expref: -99 pid: 7588 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172259:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788666086.172263:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff800/0x96bbe788361e9851 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9858 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172268:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff800 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:0.0:1788666086.172271:0:5796:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff800/0x96bbe788361e9851 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e9858 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172277:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff800/0x96bbe788361e9851 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e9858 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788666086.172283:0:5796:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff800/0x96bbe788361e9851 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e9858 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666086.172289:0:5796:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788666086.172301:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff800/0x96bbe788361e9851 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9858 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172307:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788666086.172320:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff800/0x96bbe788361e9851 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9858 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172326:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff800/0x96bbe788361e9851 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9858 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172335:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666086.172338:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe400/0x96bbe788361e97da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e97e1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172343:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814fe400 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:0.0:1788666086.172346:0:5796:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe400/0x96bbe788361e97da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e97e1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172353:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe400/0x96bbe788361e97da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e97e1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788666086.172359:0:5796:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe400/0x96bbe788361e97da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e97e1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666086.172365:0:5796:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788666086.172375:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe400/0x96bbe788361e97da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e97e1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172380:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788666086.172394:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe400/0x96bbe788361e97da lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e97e1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172401:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe400/0x96bbe788361e97da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e97e1 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172412:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666086.172418:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666086.172420:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666086.172425:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666086.172431:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666086.172441:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186172160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788666086.172469:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666086.172489:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788666086.172494:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186172288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788666086.172512:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666086.172537:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186172416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788666086.172556:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666086.172624:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186172160 00000100:00100000:0.0:1788666086.172629:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186172160 00010000:00010000:0.0:1788666086.172645:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab283fd5e00/0x96bbe788361e98ba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e98b3 expref: 19 pid: 5800 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666086.172660:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186172288 00000100:00100000:0.0:1788666086.172662:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186172288 00010000:00010000:0.0:1788666086.172669:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab2814ff200/0x96bbe788361e9858 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9851 expref: 20 pid: 5801 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666086.172678:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186172416 00000100:00100000:0.0:1788666086.172680:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186172416 00010000:00010000:0.0:1788666086.172687:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab283fd5200/0x96bbe788361e97e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e97da expref: 21 pid: 5802 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666086.172698:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788666086.172704:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:633727f4-1aad-4438-919b-34cfb144e459+21:3277:x1875552186172160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788666086.172715:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666086.172726:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab283fd5e00/0x96bbe788361e98ba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e98b3 expref: 21 pid: 5800 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172736:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab283fd5e00/0x96bbe788361e98ba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e98b3 expref: 21 pid: 5800 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172751:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666086.172777:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:633727f4-1aad-4438-919b-34cfb144e459+21:3277:x1875552186172160:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666086.172783:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788666086.172794:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788666086.172800:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:633727f4-1aad-4438-919b-34cfb144e459+20:3277:x1875552186172288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788666086.172806:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666086.172810:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab2814ff200/0x96bbe788361e9858 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9851 expref: 20 pid: 5801 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172818:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab2814ff200/0x96bbe788361e9858 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e9851 expref: 20 pid: 5801 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172826:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666086.172842:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:633727f4-1aad-4438-919b-34cfb144e459+20:3277:x1875552186172288:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666086.172848:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788666086.172857:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788666086.172861:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186172416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788666086.172868:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666086.172871:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab283fd5200/0x96bbe788361e97e1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e97da expref: 19 pid: 5802 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172888:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab283fd5200/0x96bbe788361e97e1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e97da expref: 19 pid: 5802 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666086.172897:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666086.172919:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186172416:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666086.172925:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788666086.172958:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186172416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788666086.172978:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186172288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788666086.172985:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186172160:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788666086.173296:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab283fd5e00/0x96bbe788361e98ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e98b3 expref: 18 pid: 5800 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666086.173307:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae726680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875552186171776:0@lo:104: 00010000:00010000:1.0:1788666086.173317:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2814ff200/0x96bbe788361e9858 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e9851 expref: 17 pid: 5801 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666086.173325:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae724e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875552186171904:0@lo:104: 00010000:00010000:1.0:1788666086.173333:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab283fd5200/0x96bbe788361e97e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e97da expref: 16 pid: 5802 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666086.173339:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae843480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875552186172032:0@lo:104: 00000100:00100000:0.0:1788666086.179385:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666086.179981:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173561728 00000100:00100000:3.0:1788666086.180001:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173561728 00010000:00010000:3.0:1788666086.180043:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361e9977 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427b8 expref: 10 pid: 5802 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666086.180081:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:3.0:1788666086.180092:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2363:x1875552173561728:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666086.180121:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666086.180128:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361e9977 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427b8 expref: 10 pid: 5802 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666086.180153:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361e9977 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427b8 expref: 10 pid: 5802 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666086.180176:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab28144a600/0x96bbe788361e9a18 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666086.180185:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab28144a600/0x96bbe788361e9a18 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666086.180201:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab28144a600/0x96bbe788361e9a18 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666086.180208:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab28144a600/0x96bbe788361e9a18 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666086.180215:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab28144a600/0x96bbe788361e9a18 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666086.180222:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab28144a600/0x96bbe788361e9a18 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666086.180228:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144a600 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666086.180233:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab28144a600/0x96bbe788361e9a18 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666086.180250:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab28144a600/0x96bbe788361e9a18 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666086.180272:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab28144a600/0x96bbe788361e9a18 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666086.180284:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666086.180344:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2363:x1875552173561728:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 254us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666086.180353:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 24 00010000:00010000:2.0:1788666086.181029:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361e9977 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427b8 expref: 9 pid: 5802 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666086.181044:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae725f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8467:1875552186171648:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666086.181073:0:8467:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab28144a600/0x96bbe788361e9a18 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666086.181082:0:8467:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab28144a600/0x96bbe788361e9a18 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666086.181088:0:8467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab28144a600/0x96bbe788361e9a18 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666086.181095:0:8467:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab28144a600/0x96bbe788361e9a18 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8467 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666086.411817:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666086.411853:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666086.411890:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666086.411913:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173562112 00000100:00100000:1.0:1788666086.411923:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173562112 00000100:00100000:1.0:1788666086.411979:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173561984 00000100:00100000:1.0:1788666086.411982:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173561984 00000100:00100000:1.0:1788666086.412002:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:1.0:1788666086.412011:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+5:2364:x1875552173562112:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666086.412075:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+5:2364:x1875552173562112:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 65us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666086.412081:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:1.0:1788666086.412096:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:1.0:1788666086.412102:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+5:2364:x1875552173561984:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666086.412123:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae841180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+5:2364:x1875552173561984:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 22us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666086.412128:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00080000:1.0:1788666086.412147:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788666086.412151:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788666086.412180:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173561856 00000100:00100000:2.0:1788666086.412205:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173561856 00000100:00080000:1.0:1788666086.412263:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788666086.412426:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666086.412440:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:0.0:1788666086.412459:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173561856:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666086.412504:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173561856:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 57us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666086.412522:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:1.0:1788666086.688631:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666086.688762:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173562240 00000100:00100000:3.0:1788666086.688774:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173562240 00000100:00100000:3.0:1788666086.688836:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 172 00000100:00100000:3.0:1788666086.688846:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+9:5603:x1875552173562240:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666086.688862:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666086.688881:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e9a1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d427f7 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666086.688911:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e9a1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427f7 expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666086.688923:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e9a1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427f7 expref: 10 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666086.688932:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814ffc00, rc 0) 00000100:00100000:3.0:1788666086.688995:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:5603:x1875552173562240:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 151us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666086.689003:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 172 00000100:00100000:0.0:1788666086.703640:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666086.703883:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173562368 00000100:00100000:3.0:1788666086.703896:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173562368 00000100:00100000:3.0:1788666086.703981:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 173 00000100:00100000:3.0:1788666086.703991:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:5603:x1875552173562368:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788666086.704627:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:5603:x1875552173562368:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 634us (997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666086.704636:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 173 00000100:00100000:0.0:1788666086.708728:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666086.708792:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173562496 00000100:00100000:3.0:1788666086.708801:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173562496 00000100:00100000:3.0:1788666086.708936:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 174 00000100:00100000:3.0:1788666086.708949:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:5603:x1875552173562496:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788666086.709223:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:5603:x1875552173562496:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 Request processed in 276us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666086.709242:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 174 00000100:00100000:1.0:1788666086.722554:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666086.723211:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173562624 00000100:00100000:3.0:1788666086.723241:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173562624 00000100:00100000:3.0:1788666086.723316:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 175 00000100:00100000:3.0:1788666086.723328:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:6151:x1875552173562624:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788666086.723631:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:6151:x1875552173562624:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 305us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666086.723639:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 175 00000100:00100000:0.0:1788666086.731873:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666086.732332:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173562752 00000100:00100000:3.0:1788666086.732346:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173562752 00000100:00100000:3.0:1788666086.732413:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 176 00000100:00100000:3.0:1788666086.732424:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:6151:x1875552173562752:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788666086.732707:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:6151:x1875552173562752:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 284us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666086.732724:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 176 00010000:00010000:0.0:1788666087.435037:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666087.823889:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186172672:0@lo:400:kworker.0 00000100:00100000:2.0:1788666087.823973:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666087.824065:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186173184:0@lo:400:kworker.0 00000100:00100000:2.0:1788666087.824200:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666087.824247:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666087.824254:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186172800:0@lo:400:kworker.0 00000100:00100000:2.0:1788666087.824275:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666087.824300:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186172928:0@lo:400:kworker.0 00000100:00100000:2.0:1788666087.824319:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666087.824332:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788666087.824337:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186172544:0@lo:400:kworker.0 00000100:00100000:2.0:1788666087.824362:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666087.824379:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186173056:0@lo:400:kworker.0 00000100:00100000:2.0:1788666087.824397:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666087.824426:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186172672 00000100:00100000:2.0:1788666087.824434:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186172672 00000100:00100000:2.0:1788666087.824476:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186172800 00000100:00100000:2.0:1788666087.824478:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186172800 00000100:00100000:2.0:1788666087.824499:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186173056 00000100:00100000:2.0:1788666087.824502:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186173056 00000100:00100000:1.0:1788666087.825175:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186173184 00000100:00100000:1.0:1788666087.825194:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186173184 00000100:00100000:1.0:1788666087.825231:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186172928 00000100:00100000:1.0:1788666087.825234:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186172928 00000100:00100000:1.0:1788666087.825256:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788666087.825264:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186173184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666087.825327:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186173184:12345-0@lo:400:kworker.0 Request processed in 63us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666087.825344:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788666087.825358:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788666087.825364:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186172928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666087.825394:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186172928:12345-0@lo:400:kworker.0 Request processed in 30us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666087.825399:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788666087.825528:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788666087.825537:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186172672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666087.825570:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186172672:12345-0@lo:400:kworker.0 Request processed in 36us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666087.825576:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788666087.825610:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788666087.825616:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186172800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666087.825642:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186172800:12345-0@lo:400:kworker.0 Request processed in 28us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666087.825648:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788666087.825658:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788666087.825664:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186173056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666087.825689:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186173056:12345-0@lo:400:kworker.0 Request processed in 25us (1290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666087.825694:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788666087.825793:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788666087.825797:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788666087.825800:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666087.825836:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186173056:0@lo:400:kworker.0 00010000:00080000:2.0:1788666087.825849:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2c1b7c380 x1875552186172928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666087.825859:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186172928:0@lo:400:kworker.0 00000100:00100000:2.0:1788666087.825898:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186172800:0@lo:400:kworker.0 00000100:00100000:2.0:1788666087.825907:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186172672:0@lo:400:kworker.0 00010000:00080000:2.0:1788666087.825916:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2c1b7dc00 x1875552186173184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666103 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666087.825925:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186173184:0@lo:400:kworker.0 00000100:00100000:2.0:1788666087.825991:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186172544 00000100:00100000:2.0:1788666087.825995:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186172544 00000100:00100000:2.0:1788666087.826020:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788666087.826026:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+16:3275:x1875552186172544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666087.826071:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+16:3275:x1875552186172544:12345-0@lo:400:kworker.0 Request processed in 45us (1707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666087.826077:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788666087.826108:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186172544:0@lo:400:kworker.0 10000000:01000000:2.0:1788666088.011110:0:5804:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:2.0:1788666088.011119:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff8ab2bbf65000 from 4 10000000:01000000:2.0:1788666088.011126:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788666088.011183:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9a26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666088.011197:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9a26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666088.011208:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9a26 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666088.011245:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186173312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788666088.011343:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666088.011397:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2980ef6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788666088.011549:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186173312 00000100:00100000:3.0:1788666088.011557:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186173312 00000100:00100000:3.0:1788666088.011638:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788666088.011649:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+16:5804:x1875552186173312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666088.011663:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666088.011677:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2814ff400/0x96bbe788361e9a2d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e9a26 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666088.011701:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2814ff400/0x96bbe788361e9a2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e9a26 expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666088.011713:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2814ff400/0x96bbe788361e9a2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9a26 expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666088.011722:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814ff400, rc 0) 00000100:00100000:3.0:1788666088.011769:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186173312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666088.011775:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788666088.013675:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186173312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788666088.013703:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9a26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9a2d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666088.013735:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9a26 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9a2d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666088.013816:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186173440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666088.013869:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666088.013900:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bfb24600 going to sleep for 11 seconds 00000100:00100000:2.0:1788666088.013982:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186173440 00000100:00100000:2.0:1788666088.013989:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186173440 00000100:00100000:2.0:1788666088.014032:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788666088.014040:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186173440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788666088.014318:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186173440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666088.014326:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788666088.014567:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186173440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666088.014634:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186173568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788666088.014674:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666088.014693:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bfb24600 going to sleep for 11 seconds 00000100:00100000:2.0:1788666088.015771:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186173568 00000100:00100000:2.0:1788666088.015781:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186173568 00000100:00100000:2.0:1788666088.015827:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788666088.015837:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186173568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788666088.016041:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186173568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 205us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666088.016048:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788666088.016102:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186173568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788666088.030059:0:8535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae842a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8535:1875552186173696:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788666088.030156:0:8535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666088.030219:0:8535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a08ac180 going to sleep for 11 seconds 00000100:00100000:2.0:1788666088.032736:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186173696 00000100:00100000:2.0:1788666088.032753:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186173696 00000100:00100000:2.0:1788666088.032832:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788666088.032843:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+17:8535:x1875552186173696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788666088.033139:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+17:8535:x1875552186173696:12345-0@lo:502:llog_process_th.0 Request processed in 297us (2982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666088.033148:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788666088.033327:0:8535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae842a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8535:1875552186173696:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788666088.033369:0:8535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788666088.033381:0:8535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666088.033384:0:8535:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788666088.033391:0:8535:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab2bbf65000 00000020:00000080:1.0:1788666088.033394:0:8535:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788666088.033503:0:8535:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae842a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8535:1875552186173824:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788666088.033551:0:8535:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666088.033609:0:8535:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a08ac180 going to sleep for 11 seconds 00000100:00100000:0.0:1788666088.034643:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186173824 00000100:00100000:0.0:1788666088.034652:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186173824 00000100:00100000:0.0:1788666088.034693:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788666088.034701:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+17:8535:x1875552186173824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788666088.034918:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+17:8535:x1875552186173824:12345-0@lo:502:llog_process_th.0 Request processed in 217us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666088.034926:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788666088.035529:0:8535:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae842a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8535:1875552186173824:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788666088.035571:0:8535:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788666088.035600:0:8535:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666088.035602:0:8535:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788666088.035607:0:8535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788666088.035778:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788666088.035799:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788666088.035812:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9a26 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9a2d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666088.035824:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9a26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9a2d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666088.035848:0:5804:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:0.0:1788666088.035851:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff8ab2bcd59800 from 4 10000000:01000000:0.0:1788666088.035854:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788666088.035892:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab28144b400/0x96bbe788361e9a34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666088.035901:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab28144b400/0x96bbe788361e9a34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666088.035910:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab28144b400/0x96bbe788361e9a34 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666088.035931:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186173952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788666088.035982:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666088.036027:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bfb249c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666088.037499:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186173952 00000100:00100000:1.0:1788666088.037514:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186173952 00000100:00100000:1.0:1788666088.037572:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788666088.037601:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186173952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788666088.037618:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666088.037635:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2a1d7c400/0x96bbe788361e9a3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e9a34 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666088.037662:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2a1d7c400/0x96bbe788361e9a3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e9a34 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666088.037674:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2a1d7c400/0x96bbe788361e9a3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9a34 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666088.037684:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2a1d7c400, rc 0) 00000100:00100000:1.0:1788666088.037765:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186173952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (1782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666088.037771:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788666088.038566:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186173952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788666088.038603:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab28144b400/0x96bbe788361e9a34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9a3b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666088.038615:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab28144b400/0x96bbe788361e9a34 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9a3b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666088.038684:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186174080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666088.038725:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666088.038756:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bfb249c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788666088.038773:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186174080 00000100:00100000:0.0:1788666088.038777:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186174080 00000100:00100000:0.0:1788666088.038814:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788666088.038821:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186174080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666088.039072:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186174080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 251us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666088.039080:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788666088.039114:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186174080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666088.039141:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186174208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788666088.039183:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666088.039197:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bfb249c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788666088.039221:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186174208 00000100:00100000:0.0:1788666088.039225:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186174208 00000100:00100000:0.0:1788666088.039246:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788666088.039252:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186174208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788666088.039399:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186174208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666088.043322:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788666088.043467:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186174208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788666088.043727:0:8536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8536:1875552186174336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788666088.043797:0:8536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666088.043832:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186174336 00000100:00100000:0.0:1788666088.043838:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186174336 00000100:00100000:0.0:1788666088.043872:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788666088.043880:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+18:8536:x1875552186174336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788666088.044075:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+18:8536:x1875552186174336:12345-0@lo:502:llog_process_th.0 Request processed in 195us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666088.044089:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788666088.044120:0:8536:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bfb24600 going to sleep for 11 seconds 00000100:00100000:0.0:1788666088.044132:0:8536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8536:1875552186174336:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788666088.044153:0:8536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788666088.044162:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666088.044164:0:8536:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788666088.044169:0:8536:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab2bcd59800 00000020:00000080:0.0:1788666088.044172:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788666088.044251:0:8536:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8536:1875552186174464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788666088.044302:0:8536:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666088.044328:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186174464 00000100:00100000:0.0:1788666088.044333:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186174464 00000100:00100000:0.0:1788666088.044358:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788666088.044365:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+18:8536:x1875552186174464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788666088.044471:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+18:8536:x1875552186174464:12345-0@lo:502:llog_process_th.0 Request processed in 106us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666088.044478:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788666088.044517:0:8536:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bfb24600 going to sleep for 11 seconds 00000100:00100000:0.0:1788666088.044531:0:8536:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8536:1875552186174464:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788666088.044550:0:8536:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788666088.044555:0:8536:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666088.044557:0:8536:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788666088.044561:0:8536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788666088.044713:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788666088.044733:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788666088.044744:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab28144b400/0x96bbe788361e9a34 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9a3b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666088.044765:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab28144b400/0x96bbe788361e9a34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9a3b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666088.044776:0:5804:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1788666088.044779:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff8ab290a54800 from 4 10000000:01000000:1.0:1788666088.044782:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788666088.044807:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666088.044816:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666088.044826:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a42 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666088.044840:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186174592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788666088.044873:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666088.044914:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186174592 00000100:00100000:1.0:1788666088.044915:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a08ac240 going to sleep for 11 seconds 00000100:00100000:0.0:1788666088.044920:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186174592 00000100:00100000:0.0:1788666088.044999:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788666088.045007:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186174592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788666088.045023:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666088.045036:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab28144a800/0x96bbe788361e9a49 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e9a42 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666088.045059:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab28144a800/0x96bbe788361e9a49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e9a42 expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666088.045070:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab28144a800/0x96bbe788361e9a49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9a42 expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666088.045079:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144a800, rc 0) 00000100:00100000:0.0:1788666088.045109:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:5804:x1875552186174592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666088.045116:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788666088.045185:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae842a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186174592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788666088.045200:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9a49 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666088.045223:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a42 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9a49 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666088.045265:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186174720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666088.045288:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666088.045342:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bfb24b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788666088.045373:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186174720 00000100:00100000:1.0:1788666088.045377:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186174720 00000100:00100000:1.0:1788666088.045433:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788666088.045440:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:5804:x1875552186174720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788666088.045719:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:5804:x1875552186174720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666088.045726:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788666088.045789:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186174720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666088.045817:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186174848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788666088.045857:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666088.045870:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bfb24b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788666088.045880:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186174848 00000100:00100000:0.0:1788666088.045883:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186174848 00000100:00100000:0.0:1788666088.045901:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788666088.045906:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:5804:x1875552186174848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788666088.046015:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:5804:x1875552186174848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 109us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666088.046021:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788666088.046051:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186174848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788666088.046434:0:8538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae840000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8538:1875552186174976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788666088.046474:0:8538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666088.046532:0:8538:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a08aca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788666088.046563:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186174976 00000100:00100000:0.0:1788666088.046568:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186174976 00000100:00100000:0.0:1788666088.046691:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1788666088.046700:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:8538:x1875552186174976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788666088.046842:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:8538:x1875552186174976:12345-0@lo:502:llog_process_th.0 Request processed in 143us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666088.046848:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1788666088.046903:0:8538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae840000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8538:1875552186174976:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788666088.046926:0:8538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788666088.046934:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666088.046936:0:8538:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788666088.046943:0:8538:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab290a54800 00000020:00000080:1.0:1788666088.046945:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788666088.047002:0:8538:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae840000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8538:1875552186175104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788666088.047034:0:8538:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666088.047050:0:8538:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a08aca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788666088.047081:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186175104 00000100:00100000:0.0:1788666088.047086:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186175104 00000100:00100000:0.0:1788666088.047143:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788666088.047150:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:8538:x1875552186175104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788666088.047269:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:8538:x1875552186175104:12345-0@lo:502:llog_process_th.0 Request processed in 118us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666088.047276:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788666088.047327:0:8538:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae840000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:8538:1875552186175104:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788666088.047345:0:8538:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788666088.047349:0:8538:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666088.047350:0:8538:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788666088.047354:0:8538:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788666088.047478:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788666088.047497:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788666088.047511:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a42 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9a49 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666088.047521:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9a49 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666088.330948:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788666088.330972:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186175232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788666088.331045:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666088.331202:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186175232 00000100:00100000:2.0:1788666088.331219:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186175232 00000100:00100000:2.0:1788666088.331282:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788666088.331292:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186175232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788666088.331329:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666088.331390:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186175232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666088.331397:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788666088.331434:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2c1b7dc00 x1875552186175232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666088.331455:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186175232:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788666088.458801:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666089.356230:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186175360:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788666089.356332:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666089.356443:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186175360 00000100:00100000:2.0:1788666089.356451:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186175360 00000100:00100000:2.0:1788666089.356515:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788666089.356525:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186175360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788666089.356566:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666089.356650:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186175360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666089.356658:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788666089.356681:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788666089.356715:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2988fed80 x1875552186175360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666105 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666089.356736:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186175360:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788666089.482867:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666090.506827:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666091.533726:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666091.533770:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666091.533794:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666091.533823:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666091.533858:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173563008 00000100:00100000:0.0:1788666091.533868:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173563008 00000100:00100000:0.0:1788666091.533932:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:0.0:1788666091.533943:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+6:2361:x1875552173563008:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666091.534023:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+6:2361:x1875552173563008:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 83us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666091.534032:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:0.0:1788666091.534139:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173563136 00000100:00100000:0.0:1788666091.534144:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173563136 00000100:00100000:0.0:1788666091.534182:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173563264 00000100:00100000:0.0:1788666091.534185:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173563264 00000100:00100000:0.0:1788666091.534206:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:0.0:1788666091.534212:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+5:2361:x1875552173563136:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666091.534250:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+5:2361:x1875552173563136:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 38us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666091.534257:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:0.0:1788666091.534268:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:0.0:1788666091.534274:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+5:2361:x1875552173563264:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666091.534298:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+5:2361:x1875552173563264:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 24us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666091.534304:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00080000:0.0:1788666091.534321:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788666091.534326:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788666091.534328:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788666091.535187:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173562880 00000100:00100000:1.0:1788666091.535200:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173562880 00000100:00100000:1.0:1788666091.535248:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 193 00000100:00100000:1.0:1788666091.535256:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2361:x1875552173562880:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666091.535304:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2361:x1875552173562880:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 49us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666091.535321:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 193 00010000:00010000:0.0:1788666091.536762:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666092.555097:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666092.941281:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186175872:0@lo:400:kworker.0 00000100:00100000:0.0:1788666092.941364:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666092.941428:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788666092.941435:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186175488:0@lo:400:kworker.0 00000100:00100000:0.0:1788666092.941480:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666092.941501:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186176000:0@lo:400:kworker.0 00000100:00100000:0.0:1788666092.941526:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666092.941555:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186175616:0@lo:400:kworker.0 00000100:00100000:0.0:1788666092.941596:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666092.941614:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186176128:0@lo:400:kworker.0 00000100:00100000:0.0:1788666092.941637:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666092.941653:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788666092.941659:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186175744:0@lo:400:kworker.0 00000100:00100000:0.0:1788666092.941693:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666092.941730:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186175872 00000100:00100000:0.0:1788666092.941739:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186175872 00000100:00100000:0.0:1788666092.941812:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186176128 00000100:00100000:0.0:1788666092.941815:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186176128 00000100:00100000:0.0:1788666092.941841:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788666092.941852:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186175872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666092.941903:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186175872:12345-0@lo:400:kworker.0 Request processed in 52us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666092.941910:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788666092.941926:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788666092.941932:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186176128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666092.941962:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186176128:12345-0@lo:400:kworker.0 Request processed in 30us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666092.941968:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788666092.941985:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186175488 00000100:00100000:0.0:1788666092.941988:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186175488 00000100:00100000:0.0:1788666092.942014:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788666092.942020:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186175488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666092.942048:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186175488:12345-0@lo:400:kworker.0 Request processed in 28us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666092.942054:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788666092.942081:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186176000 00000100:00100000:0.0:1788666092.942085:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186176000 00000100:00100000:0.0:1788666092.942109:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186175616 00000100:00100000:0.0:1788666092.942112:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186175616 00000100:00100000:0.0:1788666092.942121:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186175744 00000100:00100000:0.0:1788666092.942123:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186175744 00000100:00100000:0.0:1788666092.942160:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788666092.942165:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186176000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666092.942195:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186176000:12345-0@lo:400:kworker.0 Request processed in 30us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666092.942201:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788666092.942212:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788666092.942219:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186175616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666092.942243:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae724700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186175616:12345-0@lo:400:kworker.0 Request processed in 26us (664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666092.942248:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788666092.942258:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788666092.942264:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186175744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666092.942287:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186175744:12345-0@lo:400:kworker.0 Request processed in 24us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666092.942292:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788666092.942318:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788666092.942323:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788666092.942325:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788666092.942360:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186175744:0@lo:400:kworker.0 00000100:00100000:0.0:1788666092.942369:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186175616:0@lo:400:kworker.0 00010000:00080000:0.0:1788666092.942379:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2ae724e00 x1875552186176128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666092.942388:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186176128:0@lo:400:kworker.0 00000100:00100000:0.0:1788666092.942414:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186175488:0@lo:400:kworker.0 00000100:00100000:0.0:1788666092.942433:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186176000:0@lo:400:kworker.0 00010000:00080000:0.0:1788666092.942442:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2988ffb80 x1875552186175872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666092.942451:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186175872:0@lo:400:kworker.0 00000100:00100000:2.0:1788666093.453626:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666093.453650:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186176256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788666093.453730:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666093.453794:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186176256 00000100:00100000:2.0:1788666093.453801:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186176256 00000100:00100000:2.0:1788666093.453847:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788666093.453871:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186176256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788666093.453910:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666093.453973:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186176256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666093.453980:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788666093.454034:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2c1b7ca80 x1875552186176256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666093.454058:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186176256:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788666093.580215:0:8766:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1788666093.584652:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666094.477009:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186176384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788666094.477085:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666094.477218:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186176384 00000100:00100000:0.0:1788666094.477226:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186176384 00000100:00100000:0.0:1788666094.477290:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788666094.477300:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186176384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788666094.477344:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666094.477396:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186176384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666094.477404:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:2.0:1788666094.477697:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788666094.477738:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2ae725f80 x1875552186176384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666110 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666094.477760:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186176384:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788666094.603078:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666095.627333:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666096.645057:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666096.645125:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666096.645138:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173563520 00000100:00100000:2.0:1788666096.645148:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173563520 00000100:00100000:2.0:1788666096.645219:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:2.0:1788666096.645230:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2362:x1875552173563520:12345-192.168.201.25@tcp:400:kworker.0 00000100:00080000:0.0:1788666096.645244:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666096.645313:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae724e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2362:x1875552173563520:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 84us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666096.645321:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:1.0:1788666096.645736:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173563392 00000100:00100000:1.0:1788666096.646037:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173563392 00000100:00100000:1.0:1788666096.646089:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 195 00000100:00100000:1.0:1788666096.646097:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2362:x1875552173563392:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666096.646243:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2362:x1875552173563392:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 147us (1117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666096.646251:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 195 00000100:00100000:0.0:1788666096.647883:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666096.647919:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666096.648053:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173563648 00000100:00100000:3.0:1788666096.648075:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173563648 00000100:00100000:3.0:1788666096.648138:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173563776 00000100:00100000:3.0:1788666096.648141:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173563776 00000100:00100000:3.0:1788666096.648173:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:3.0:1788666096.648187:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+5:2357:x1875552173563648:12345-192.168.201.25@tcp:9:kworker.0 00000020:00000080:3.0:1788666096.648225:0:6650:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e9985 00000100:00080000:3.0:1788666096.648237:0:6650:0:(import.c:65:import_set_state_nolock()) ffff8ab2ae43a000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788666096.648247:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:2.0:1788666096.648256:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+5:2357:x1875552173563776:12345-192.168.201.25@tcp:9:kworker.0 00000020:00000080:2.0:1788666096.648284:0:8429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e998c 00000001:00000004:3.0:1788666096.648285:0:6650:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00080000:2.0:1788666096.648292:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8ab2b44db800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788666096.648314:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788666096.648713:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+2:2357:x1875552173563648:12345-192.168.201.25@tcp:9:kworker.0 Request processed in 529us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666096.648721:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00010000:00010000:3.0:1788666096.648775:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666096.648851:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788666096.648861:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788666096.648865:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788666096.649283:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+2:2357:x1875552173563776:12345-192.168.201.25@tcp:9:kworker.0 Request processed in 1027us (1361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666096.649291:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00010000:00010000:2.0:1788666096.653859:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666097.681110:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666098.058927:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186176896:0@lo:400:kworker.0 00000100:00100000:0.0:1788666098.059034:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666098.059105:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788666098.059111:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186176512:0@lo:400:kworker.0 00000100:00100000:0.0:1788666098.059141:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666098.059175:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186177024:0@lo:400:kworker.0 00000100:00100000:0.0:1788666098.059202:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666098.059229:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186176640:0@lo:400:kworker.0 00000100:00100000:0.0:1788666098.059253:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666098.059272:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab18253fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186177152:0@lo:400:kworker.0 00000100:00100000:0.0:1788666098.059295:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666098.059314:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788666098.059319:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186176768:0@lo:400:kworker.0 00000100:00100000:0.0:1788666098.059340:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666098.059376:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186176512 00000100:00100000:0.0:1788666098.059384:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186176512 00000100:00100000:0.0:1788666098.059435:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788666098.059444:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186176512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666098.059499:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186176512:12345-0@lo:400:kworker.0 Request processed in 56us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666098.059506:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1788666098.059544:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186177024 00000100:00100000:0.0:1788666098.059547:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186177024 00000100:00100000:0.0:1788666098.059598:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186176640 00000100:00100000:0.0:1788666098.059601:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186176640 00000100:00100000:0.0:1788666098.059612:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186176768 00000100:00100000:0.0:1788666098.059614:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186176768 00000100:00100000:0.0:1788666098.059626:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788666098.059632:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186177024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666098.059663:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186177024:12345-0@lo:400:kworker.0 Request processed in 31us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666098.059668:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788666098.059689:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788666098.059695:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186176640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666098.059729:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186176640:12345-0@lo:400:kworker.0 Request processed in 34us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666098.059734:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788666098.059745:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788666098.059750:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186176768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666098.059777:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186176768:12345-0@lo:400:kworker.0 Request processed in 26us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666098.059782:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788666098.059809:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186176896 00000100:00100000:0.0:1788666098.059813:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186176896 00000100:00100000:0.0:1788666098.059837:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186177152 00000100:00100000:0.0:1788666098.059840:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186177152 00000100:00100000:0.0:1788666098.059861:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788666098.059866:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186176896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666098.059896:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186176896:12345-0@lo:400:kworker.0 Request processed in 30us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666098.059902:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788666098.059912:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788666098.059918:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186177152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666098.059944:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186177152:12345-0@lo:400:kworker.0 Request processed in 26us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666098.059949:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788666098.059970:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788666098.059973:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788666098.059976:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666098.060018:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186176768:0@lo:400:kworker.0 00000100:00100000:0.0:1788666098.060028:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186176640:0@lo:400:kworker.0 00010000:00080000:0.0:1788666098.060056:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab18253fb80 x1875552186177152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666098.060068:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab18253fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186177152:0@lo:400:kworker.0 00000100:00100000:0.0:1788666098.060098:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186176512:0@lo:400:kworker.0 00000100:00100000:0.0:1788666098.060108:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186177024:0@lo:400:kworker.0 00010000:00080000:0.0:1788666098.060118:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2b46b7800 x1875552186176896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666098.060127:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186176896:0@lo:400:kworker.0 00000100:00100000:1.0:1788666098.570971:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788666098.571013:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186177280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788666098.571119:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666098.571680:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186177280 00000100:00100000:2.0:1788666098.571690:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186177280 00000100:00100000:2.0:1788666098.571758:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788666098.571768:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186177280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788666098.571807:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666098.571861:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae840000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186177280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666098.571867:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788666098.571907:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2c1b7fb80 x1875552186177280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666098.571927:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186177280:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788666098.699479:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788666098.875196:0:9010:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing yml_node 00000100:00100000:0.0:1788666099.600035:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186177408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788666099.600114:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666099.600345:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186177408 00000100:00100000:1.0:1788666099.600353:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186177408 00000100:00100000:1.0:1788666099.600420:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788666099.600429:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186177408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788666099.600465:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666099.600509:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186177408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666099.600516:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788666099.601383:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2ae840e00 x1875552186177408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666115 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666099.601408:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186177408:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788666099.723372:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788666100.676434:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0911d461-5865-4ef7-8c3e-012fc04add58 00000020:00000080:1.0:1788666100.676447:0:7606:0:(genops.c:885:class_export_put()) final put ffff8ab2b44d8800/0911d461-5865-4ef7-8c3e-012fc04add58 00000020:00000080:0.0:1788666100.676781:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2b44d8800/0911d461-5865-4ef7-8c3e-012fc04add58 for lustre-OST0001 00000020:00000080:0.0:1788666100.676838:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab2b44db800 for lustre-OST0001 00010000:00010000:2.0:1788666100.747264:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788666101.718843:0:6678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0911d461-5865-4ef7-8c3e-012fc04add58 00000020:00000080:0.0:1788666101.718852:0:6678:0:(genops.c:885:class_export_put()) final put ffff8ab2b44de000/0911d461-5865-4ef7-8c3e-012fc04add58 00000020:00000080:2.0:1788666101.718985:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2b44de000/0911d461-5865-4ef7-8c3e-012fc04add58 for lustre-OST0000 00000020:00000080:2.0:1788666101.719036:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab2ae43a000 for lustre-OST0000 00000100:00100000:3.0:1788666101.763842:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666101.763934:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173563904 00000100:00100000:0.0:1788666101.763945:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173563904 00000100:00100000:0.0:1788666101.764067:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 197 00000100:00100000:0.0:1788666101.764077:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2361:x1875552173563904:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666101.764084:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666101.764178:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2361:x1875552173563904:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 102us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666101.764325:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 197 00000100:00100000:2.0:1788666101.769035:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173564032 00000100:00100000:2.0:1788666101.769053:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173564032 00000100:00100000:2.0:1788666101.769145:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:2.0:1788666101.769156:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+6:2361:x1875552173564032:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666101.769402:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+6:2361:x1875552173564032:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 246us (5315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666101.769411:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00080000:0.0:1788666101.769653:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788666101.770862:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666102.795610:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788666102.901362:0:9206:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.3 00000100:00100000:2.0:1788666103.178946:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186177664:0@lo:400:kworker.0 00000100:00100000:2.0:1788666103.179039:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666103.179110:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186178176:0@lo:400:kworker.0 00000100:00100000:1.0:1788666103.179211:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186177920:0@lo:400:kworker.0 00000100:00100000:1.0:1788666103.179250:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666103.179293:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788666103.179299:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186177536:0@lo:400:kworker.0 00000100:00100000:1.0:1788666103.179326:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666103.179347:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186178048:0@lo:400:kworker.0 00000100:00100000:1.0:1788666103.179368:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666103.179400:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186177920 00000100:00100000:1.0:1788666103.179408:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186177920 00000100:00100000:1.0:1788666103.179464:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788666103.179474:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186177920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666103.179526:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186177920:12345-0@lo:400:kworker.0 Request processed in 53us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666103.179534:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788666103.179555:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186177536 00000100:00100000:1.0:1788666103.179558:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186177536 00000100:00100000:1.0:1788666103.179607:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788666103.179614:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186177536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666103.179643:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186177536:12345-0@lo:400:kworker.0 Request processed in 30us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666103.179648:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1788666103.179675:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186177664 00000100:00100000:1.0:1788666103.179679:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186177664 00000100:00100000:1.0:1788666103.179704:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186178048 00000100:00100000:1.0:1788666103.179706:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186178048 00000100:00100000:1.0:1788666103.179725:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788666103.179731:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186177664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666103.179762:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186177664:12345-0@lo:400:kworker.0 Request processed in 31us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666103.179778:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788666103.179790:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788666103.179796:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186178048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666103.179822:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186178048:12345-0@lo:400:kworker.0 Request processed in 27us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666103.179827:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1788666103.179843:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788666103.179848:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788666103.179885:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186177536:0@lo:400:kworker.0 00000100:00100000:1.0:1788666103.179898:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186178048:0@lo:400:kworker.0 00010000:00080000:1.0:1788666103.179909:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2c1b7dc00 x1875552186177920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666103.179918:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186177920:0@lo:400:kworker.0 00000100:00100000:2.0:1788666103.180274:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666103.180314:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186177664:0@lo:400:kworker.0 00000100:00100000:2.0:1788666103.180324:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666103.180332:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186177792:0@lo:400:kworker.0 00000100:00100000:2.0:1788666103.180354:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666103.180378:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186177792 00000100:00100000:2.0:1788666103.180382:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186177792 00000100:00100000:2.0:1788666103.180416:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788666103.180424:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186177792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666103.180462:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186177792:12345-0@lo:400:kworker.0 Request processed in 39us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666103.180467:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788666103.180487:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666103.180502:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186177792:0@lo:400:kworker.0 00000100:00100000:0.0:1788666103.180661:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186178176 00000100:00100000:0.0:1788666103.180667:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186178176 00000100:00100000:0.0:1788666103.180699:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788666103.180706:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186178176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666103.180742:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186178176:12345-0@lo:400:kworker.0 Request processed in 37us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666103.180748:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788666103.180904:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788666103.180925:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2c1b7f100 x1875552186178176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666103.180935:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186178176:0@lo:400:kworker.0 00000100:00100000:0.0:1788666103.691845:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab18253e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186178304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788666103.691923:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666103.692016:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186178304 00000100:00100000:0.0:1788666103.692026:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186178304 00000100:00100000:0.0:1788666103.692079:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788666103.692091:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186178304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788666103.692136:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666103.692183:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186178304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666103.692190:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1788666103.692231:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab18253e680 x1875552186178304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666119 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666103.692251:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab18253e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186178304:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788666103.819917:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666104.715005:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788666104.715034:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186178432:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788666104.715117:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666104.715320:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186178432 00000100:00100000:1.0:1788666104.715349:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186178432 00000100:00100000:1.0:1788666104.715409:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788666104.715421:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186178432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788666104.715461:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666104.715544:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186178432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666104.715552:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788666104.715695:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2ae843480 x1875552186178432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666104.715715:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae843480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186178432:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788666104.843489:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788666105.621932:0:9304:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.3 00010000:00010000:1.0:1788666105.869211:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666106.886433:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666106.886483:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666106.886618:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173564288 00000100:00100000:1.0:1788666106.886630:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173564288 00000100:00100000:1.0:1788666106.886702:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:1.0:1788666106.886722:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+6:2361:x1875552173564288:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666106.886800:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+6:2361:x1875552173564288:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 80us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666106.886808:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:3.0:1788666106.888100:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173564160 00000100:00100000:3.0:1788666106.888110:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173564160 00000100:00100000:3.0:1788666106.888215:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 199 00000100:00100000:3.0:1788666106.888224:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2361:x1875552173564160:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666106.888297:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2361:x1875552173564160:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 74us (1875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666106.888304:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 199 00000100:00080000:2.0:1788666106.889253:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788666106.891747:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666107.915978:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666108.299050:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186178944:0@lo:400:kworker.0 00000100:00100000:1.0:1788666108.299127:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666108.299195:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186178560:0@lo:400:kworker.0 00000100:00100000:0.0:1788666108.299233:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666108.299280:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186179072:0@lo:400:kworker.0 00000100:00100000:0.0:1788666108.299307:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666108.299344:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186178688:0@lo:400:kworker.0 00000100:00100000:0.0:1788666108.299364:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666108.299380:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186179200:0@lo:400:kworker.0 00000100:00100000:0.0:1788666108.299404:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186178816:0@lo:400:kworker.0 00000100:00100000:0.0:1788666108.299424:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666108.299451:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186179072 00000100:00100000:0.0:1788666108.299458:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186179072 00000100:00100000:0.0:1788666108.299504:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186178688 00000100:00100000:0.0:1788666108.299507:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186178688 00000100:00100000:0.0:1788666108.299518:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186178816 00000100:00100000:0.0:1788666108.299520:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186178816 00000100:00100000:0.0:1788666108.299533:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788666108.299541:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186179072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666108.299606:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186179072:12345-0@lo:400:kworker.0 Request processed in 65us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666108.299614:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788666108.299630:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788666108.299636:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186178688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666108.299677:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186178688:12345-0@lo:400:kworker.0 Request processed in 42us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666108.299683:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788666108.299696:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788666108.299702:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186178816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666108.299732:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186178816:12345-0@lo:400:kworker.0 Request processed in 30us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666108.299737:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1788666108.299752:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666108.299782:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186179072:0@lo:400:kworker.0 00000100:00100000:0.0:1788666108.299813:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186178816:0@lo:400:kworker.0 00000100:00100000:0.0:1788666108.299873:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186178560 00000100:00100000:0.0:1788666108.299876:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186178560 00000100:00100000:0.0:1788666108.299902:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788666108.299908:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186178560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666108.299941:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186178560:12345-0@lo:400:kworker.0 Request processed in 33us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666108.299948:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1788666108.299982:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186178560:0@lo:400:kworker.0 00000100:00100000:0.0:1788666108.301693:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666108.312464:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186178688:0@lo:400:kworker.0 00000100:00100000:2.0:1788666108.314913:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186178944 00000100:00100000:2.0:1788666108.314932:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186178944 00000100:00100000:2.0:1788666108.315008:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186179200 00000100:00100000:2.0:1788666108.315012:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186179200 00000100:00100000:2.0:1788666108.315050:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788666108.315062:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186178944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666108.315370:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186178944:12345-0@lo:400:kworker.0 Request processed in 309us (16242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666108.315388:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788666108.315406:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788666108.315413:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186179200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666108.315451:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186179200:12345-0@lo:400:kworker.0 Request processed in 39us (13764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666108.315457:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788666108.315511:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2c1b7d180 x1875552186178944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666108.315526:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186178944:0@lo:400:kworker.0 00000100:00080000:0.0:1788666108.316070:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788666108.316075:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788666108.316101:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bfaad880 x1875552186179200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666108.316126:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186179200:0@lo:400:kworker.0 00000001:02000400:0.0:1788666108.475453:0:9402:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.3 00000100:00100000:3.0:1788666108.812183:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788666108.812207:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186179328:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788666108.812288:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666108.812607:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186179328 00000100:00100000:2.0:1788666108.812616:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186179328 00000100:00100000:2.0:1788666108.812677:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788666108.812687:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186179328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788666108.812740:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666108.812795:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186179328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666108.812802:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788666108.812847:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bfaac700 x1875552186179328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666124 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666108.812878:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186179328:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788666108.938872:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666109.836188:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186179456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788666109.836268:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666109.836319:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186179456 00000100:00100000:3.0:1788666109.836328:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186179456 00000100:00100000:2.0:1788666109.836501:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788666109.836513:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186179456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788666109.836556:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666109.836630:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186179456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666109.836638:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788666109.836662:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2aea3df80 x1875552186179456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666109.836683:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186179456:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788666109.962691:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788666110.120050:0:9450:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 23:41:48 EDT 2026 00010000:00010000:3.0:1788666110.987052:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666112.003075:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666112.003127:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666112.003278:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173564544 00000100:00100000:0.0:1788666112.003289:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173564544 00000100:00100000:0.0:1788666112.003362:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:0.0:1788666112.003373:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173564544:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666112.003451:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173564544:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 80us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666112.003458:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00080000:3.0:1788666112.003865:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788666112.003932:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173564416 00000100:00100000:1.0:1788666112.003939:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173564416 00000100:00100000:1.0:1788666112.003978:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 201 00000100:00100000:1.0:1788666112.003986:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2364:x1875552173564416:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666112.004027:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2364:x1875552173564416:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 42us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666112.004034:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 201 00010000:00010000:3.0:1788666112.011245:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666113.035494:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666113.427566:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186179712:0@lo:400:kworker.0 00000100:00100000:3.0:1788666113.427659:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666113.427717:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186180224:0@lo:400:kworker.0 00000100:00100000:3.0:1788666113.427738:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666113.427766:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788666113.427780:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186179840:0@lo:400:kworker.0 00000100:00100000:3.0:1788666113.427803:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666113.427846:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186179712 00000100:00100000:3.0:1788666113.427855:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186179712 00000100:00100000:3.0:1788666113.427910:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186179840 00000100:00100000:3.0:1788666113.427914:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186179840 00000100:00100000:3.0:1788666113.427941:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788666113.427947:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186179712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666113.427989:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186179712:12345-0@lo:400:kworker.0 Request processed in 43us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666113.428009:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788666113.428027:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788666113.428034:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186179840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666113.428062:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186179840:12345-0@lo:400:kworker.0 Request processed in 29us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666113.428068:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788666113.428091:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186180224 00000100:00100000:3.0:1788666113.428095:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186180224 00000100:00100000:3.0:1788666113.428141:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788666113.428148:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186180224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666113.428170:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186180224:12345-0@lo:400:kworker.0 Request processed in 24us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666113.428173:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788666113.428189:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788666113.428193:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666113.428219:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186179840:0@lo:400:kworker.0 00000100:00100000:3.0:1788666113.428225:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186179712:0@lo:400:kworker.0 00010000:00080000:3.0:1788666113.428234:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2aea3f800 x1875552186180224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666113.428241:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186180224:0@lo:400:kworker.0 00000100:00100000:2.0:1788666113.428311:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186179968:0@lo:400:kworker.0 00000100:00100000:2.0:1788666113.428334:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666113.428361:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788666113.428364:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186179584:0@lo:400:kworker.0 00000100:00100000:2.0:1788666113.428385:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666113.428408:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186180096:0@lo:400:kworker.0 00000100:00100000:2.0:1788666113.428431:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666113.428462:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186179584 00000100:00100000:2.0:1788666113.428465:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186179584 00000100:00100000:2.0:1788666113.428489:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788666113.428493:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298878850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186179584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666113.428526:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298878850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186179584:12345-0@lo:400:kworker.0 Request processed in 32us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666113.428532:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788666113.428575:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186179584:0@lo:400:kworker.0 00000100:00100000:2.0:1788666113.428622:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186180096 00000100:00100000:2.0:1788666113.428625:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186180096 00000100:00100000:2.0:1788666113.428650:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788666113.428654:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186180096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666113.428684:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186180096:12345-0@lo:400:kworker.0 Request processed in 29us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666113.428689:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788666113.428702:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666113.428716:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186180096:0@lo:400:kworker.0 00000100:00100000:3.0:1788666113.430026:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186179968 00000100:00100000:3.0:1788666113.430043:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186179968 00000100:00100000:3.0:1788666113.430176:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788666113.430186:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186179968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666113.430268:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186179968:12345-0@lo:400:kworker.0 Request processed in 85us (1933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666113.430273:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1788666113.430309:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2aea3d180 x1875552186179968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666113.430320:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186179968:0@lo:400:kworker.0 00000100:00080000:2.0:1788666113.443302:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788666113.930967:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788666113.930992:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186180352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788666113.931079:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666113.931339:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186180352 00000100:00100000:2.0:1788666113.931347:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186180352 00000100:00100000:2.0:1788666113.931406:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788666113.931416:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186180352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788666113.931464:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666113.931523:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186180352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666113.931530:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788666113.931981:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bfaac380 x1875552186180352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666113.932003:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186180352:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788666114.061398:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666114.955013:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186180480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788666114.955199:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666114.955427:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186180480 00000100:00100000:3.0:1788666114.955436:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186180480 00000100:00100000:3.0:1788666114.955497:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788666114.955508:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186180480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788666114.955551:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666114.955733:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186180480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 226us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666114.955742:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788666114.958800:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2aea3d180 x1875552186180480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666130 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666114.958844:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186180480:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788666115.085049:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666116.109881:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666117.124540:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666117.124639:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666117.124677:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173564800 00000100:00100000:3.0:1788666117.124692:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173564800 00000100:00100000:3.0:1788666117.124797:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:3.0:1788666117.124817:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173564800:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666117.124920:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173564800:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 111us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666117.124928:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:2.0:1788666117.125310:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173564672 00000100:00100000:2.0:1788666117.125319:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173564672 00000100:00100000:2.0:1788666117.125356:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 203 00000100:00100000:2.0:1788666117.125365:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2363:x1875552173564672:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666117.125396:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2363:x1875552173564672:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 34us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666117.125403:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 203 00000100:00080000:2.0:1788666117.125434:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788666117.141974:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666118.157267:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666118.539009:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186180608:0@lo:400:kworker.0 00000100:00100000:3.0:1788666118.539477:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186180992:0@lo:400:kworker.0 00000100:00100000:0.0:1788666118.539525:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666118.539528:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666118.539628:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186181120:0@lo:400:kworker.0 00000100:00100000:1.0:1788666118.539666:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186180608 00000100:00100000:1.0:1788666118.539675:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186180608 00000100:00100000:1.0:1788666118.539740:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788666118.539750:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186180608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666118.539808:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186180608:12345-0@lo:400:kworker.0 Request processed in 60us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666118.539826:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788666118.539943:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666118.540040:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186180608:0@lo:400:kworker.0 00000100:00100000:0.0:1788666118.540077:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186180736:0@lo:400:kworker.0 00000100:00100000:0.0:1788666118.540101:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666118.541603:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b422b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186181248:0@lo:400:kworker.0 00000100:00100000:0.0:1788666118.541744:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666118.541773:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788666118.541780:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186180864:0@lo:400:kworker.0 00000100:00100000:0.0:1788666118.541804:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666118.541885:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186181120 00000100:00100000:1.0:1788666118.541894:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186181120 00000100:00100000:1.0:1788666118.541961:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186180736 00000100:00100000:1.0:1788666118.541965:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186180736 00000100:00100000:1.0:1788666118.541987:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788666118.541996:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186181120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666118.542192:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186180864 00000100:00100000:0.0:1788666118.542196:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186180864 00000100:00100000:0.0:1788666118.542227:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788666118.542234:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186180736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666118.542283:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186180736:12345-0@lo:400:kworker.0 Request processed in 49us (2180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666118.542291:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788666118.542308:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788666118.542314:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186180864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666118.542343:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186180864:12345-0@lo:400:kworker.0 Request processed in 29us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666118.542349:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788666118.542471:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186181120:12345-0@lo:400:kworker.0 Request processed in 476us (2527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666118.542477:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788666118.542559:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186180992 00000100:00100000:0.0:1788666118.542564:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186180992 00000100:00100000:0.0:1788666118.542618:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186181248 00000100:00100000:0.0:1788666118.542621:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186181248 00000100:00100000:0.0:1788666118.542926:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788666118.542935:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186180992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666118.542975:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186180992:12345-0@lo:400:kworker.0 Request processed in 42us (3445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666118.542981:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788666118.542993:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788666118.543012:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186181248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666118.543177:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186181248:12345-0@lo:400:kworker.0 Request processed in 165us (1433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666118.543183:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788666118.543236:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186181120:0@lo:400:kworker.0 00000100:00100000:0.0:1788666118.543269:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186180864:0@lo:400:kworker.0 00000100:00100000:0.0:1788666118.543282:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186180736:0@lo:400:kworker.0 00010000:00080000:0.0:1788666118.543296:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2b422b800 x1875552186181248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666118.543307:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b422b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186181248:0@lo:400:kworker.0 00000100:00080000:0.0:1788666118.543470:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788666118.543475:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788666118.543478:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788666118.545812:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bc3f1f80 x1875552186180992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666118.547358:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186180992:0@lo:400:kworker.0 00000100:00100000:0.0:1788666119.051249:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186181376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788666119.051339:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666119.051517:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186181376 00000100:00100000:3.0:1788666119.051529:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186181376 00000100:00100000:3.0:1788666119.051749:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788666119.051761:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186181376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788666119.051812:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666119.051929:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186181376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 170us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666119.051937:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1788666119.054329:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bfaadc00 x1875552186181376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666119.054363:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186181376:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788666119.178754:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666120.076444:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186181504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788666120.076526:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666120.076801:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186181504 00000100:00100000:3.0:1788666120.076811:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186181504 00000100:00100000:3.0:1788666120.076938:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788666120.076954:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b422bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186181504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788666120.076995:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666120.077059:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b422bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186181504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666120.077065:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788666120.077276:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2aea3e300 x1875552186181504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666120.077296:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186181504:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788666120.077346:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788666120.202702:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666121.236574:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666122.246643:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666122.246706:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666122.246753:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173564928 00000100:00100000:0.0:1788666122.246768:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173564928 00000100:00100000:0.0:1788666122.246832:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 205 00000100:00100000:0.0:1788666122.246844:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2364:x1875552173564928:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666122.246929:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2364:x1875552173564928:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 87us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666122.246937:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 205 00000100:00100000:2.0:1788666122.247402:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173565056 00000100:00100000:2.0:1788666122.247409:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173565056 00000100:00100000:2.0:1788666122.247472:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:2.0:1788666122.247481:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173565056:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666122.247531:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173565056:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 52us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666122.247538:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00080000:0.0:1788666122.253113:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788666122.258032:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666123.274839:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666123.659434:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186182016:0@lo:400:kworker.0 00000100:00100000:0.0:1788666123.659517:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666123.659610:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788666123.659618:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186181632:0@lo:400:kworker.0 00000100:00100000:0.0:1788666123.659648:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666123.659670:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186182144:0@lo:400:kworker.0 00000100:00100000:0.0:1788666123.659695:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666123.659722:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186181888:0@lo:400:kworker.0 00000100:00100000:0.0:1788666123.659744:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666123.659764:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788666123.659769:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875552186181760:0@lo:400:kworker.0 00000100:00100000:0.0:1788666123.659792:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666123.659806:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186182272:0@lo:400:kworker.0 00000100:00100000:0.0:1788666123.659824:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666123.659855:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186182016 00000100:00100000:0.0:1788666123.659863:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186182016 00000100:00100000:0.0:1788666123.659927:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186182272 00000100:00100000:0.0:1788666123.659930:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186182272 00000100:00100000:2.0:1788666123.660075:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186181632 00000100:00100000:2.0:1788666123.660080:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186181632 00000100:00100000:2.0:1788666123.660112:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788666123.660120:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186181632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666123.660176:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186181632:12345-0@lo:400:kworker.0 Request processed in 57us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666123.660202:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1788666123.660242:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186182144 00000100:00100000:2.0:1788666123.660246:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186182144 00000100:00100000:2.0:1788666123.660272:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186181888 00000100:00100000:2.0:1788666123.660275:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186181888 00000100:00100000:2.0:1788666123.660286:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186181760 00000100:00100000:2.0:1788666123.660288:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186181760 00000100:00100000:2.0:1788666123.660299:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788666123.660305:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186182144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666123.660335:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186182144:12345-0@lo:400:kworker.0 Request processed in 30us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666123.660342:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788666123.660352:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788666123.660357:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186181888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666123.660384:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186181888:12345-0@lo:400:kworker.0 Request processed in 27us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666123.660390:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788666123.660402:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788666123.660408:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875552186181760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666123.660434:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875552186181760:12345-0@lo:400:kworker.0 Request processed in 27us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666123.660440:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788666123.660495:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875552186181760:0@lo:400:kworker.0 00000100:00100000:2.0:1788666123.660505:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186181888:0@lo:400:kworker.0 00000100:00100000:2.0:1788666123.660532:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186181632:0@lo:400:kworker.0 00000100:00100000:2.0:1788666123.660548:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186182144:0@lo:400:kworker.0 00000100:00100000:0.0:1788666123.660661:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788666123.660670:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186182016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666123.661310:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186182016:12345-0@lo:400:kworker.0 Request processed in 639us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666123.661319:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788666123.661336:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788666123.661345:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186182272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666123.661407:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186182272:12345-0@lo:400:kworker.0 Request processed in 64us (1581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666123.661413:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788666123.661438:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788666123.661443:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788666123.661446:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788666123.662221:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2c1b7e300 x1875552186182272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666123.662239:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186182272:0@lo:400:kworker.0 00010000:00080000:2.0:1788666123.663722:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2c1b7d180 x1875552186182016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666139 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666123.663739:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186182016:0@lo:400:kworker.0 00000100:00100000:1.0:1788666124.171375:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186182400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788666124.171452:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666124.171954:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186182400 00000100:00100000:0.0:1788666124.171974:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186182400 00000100:00100000:0.0:1788666124.172051:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788666124.172065:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4228700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186182400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788666124.172112:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666124.172182:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4228700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186182400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666124.172189:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788666124.172302:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bfaac000 x1875552186182400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666124.172323:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186182400:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788666124.298893:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666125.197523:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186182528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788666125.197667:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666125.198289:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186182528 00000100:00100000:3.0:1788666125.198300:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186182528 00000100:00100000:3.0:1788666125.198419:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788666125.198435:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186182528:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788666125.198740:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788666125.199873:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666125.200200:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186182528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1767us (2527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666125.200239:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788666125.200395:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2aea3ea00 x1875552186182528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666125.200424:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186182528:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788666125.322840:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788666126.310434:0:10080:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 23:42:05 (1788666125) === 00010000:00010000:3.0:1788666126.355747:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666126.869400:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666126.869965:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173565184 00000100:00100000:1.0:1788666126.869981:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173565184 00000100:00100000:1.0:1788666126.870058:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 207 00000100:00100000:1.0:1788666126.870068:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:8151:x1875552173565184:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788666126.870088:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666126.870110:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2a1d7c200/0x96bbe788361e9a50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d427fe expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666126.870142:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2a1d7c200/0x96bbe788361e9a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427fe expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666126.870155:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2a1d7c200/0x96bbe788361e9a50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427fe expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666126.870165:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2a1d7c200, rc 0) 00000100:00100000:1.0:1788666126.870309:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+11:8151:x1875552173565184:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 174us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666126.870317:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 207 00000100:00100000:2.0:1788666126.880015:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666126.891312:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173565312 00000100:00100000:0.0:1788666126.891330:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173565312 00000100:00100000:0.0:1788666126.891410:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 208 00000100:00100000:0.0:1788666126.891421:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+11:8151:x1875552173565312:12345-192.168.201.25@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788666126.892137:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+11:8151:x1875552173565312:12345-192.168.201.25@tcp:501:mount.lustre.0 Request processed in 715us (12129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666126.892147:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 208 00000100:00100000:0.0:1788666126.894669:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666126.897176:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173565440 00000100:00100000:2.0:1788666126.897191:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173565440 00000100:00100000:2.0:1788666126.897263:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 209 00000100:00100000:2.0:1788666126.897272:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+11:8151:x1875552173565440:12345-192.168.201.25@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788666126.897554:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+11:8151:x1875552173565440:12345-192.168.201.25@tcp:503:mount.lustre.0 Request processed in 271us (2883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666126.897563:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 209 00000100:00100000:3.0:1788666126.900996:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666126.901324:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173565568 00000100:00100000:1.0:1788666126.901340:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173565568 00000100:00100000:1.0:1788666126.901425:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 210 00000100:00100000:1.0:1788666126.901470:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298878450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+11:8155:x1875552173565568:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788666126.901869:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298878450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+11:8155:x1875552173565568:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 400us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666126.901878:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 210 00000100:00100000:3.0:1788666126.928632:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666126.929993:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173565696 00000100:00100000:0.0:1788666126.930011:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173565696 00000100:00100000:0.0:1788666126.930090:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 211 00000100:00100000:0.0:1788666126.930119:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+11:8155:x1875552173565696:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788666126.930478:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+11:8155:x1875552173565696:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 361us (1898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666126.930487:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 211 00000100:00100000:0.0:1788666126.937042:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666126.937206:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173565824 00000100:00100000:1.0:1788666126.937219:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173565824 00000100:00100000:1.0:1788666126.937281:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 212 00000100:00100000:1.0:1788666126.937292:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298878c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+11:8151:x1875552173565824:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788666126.937312:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666126.937331:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361e9a57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42828 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666126.937360:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361e9a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42828 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666126.937373:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361e9a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42828 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666126.937383:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2a1d7cc00, rc 0) 00000100:00100000:1.0:1788666126.937999:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298878c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:8151:x1875552173565824:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 705us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666126.938007:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 212 00000100:00100000:3.0:1788666126.949675:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666126.949892:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173565952 00000100:00100000:2.0:1788666126.949903:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173565952 00000100:00100000:2.0:1788666126.950020:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 213 00000100:00100000:2.0:1788666126.950032:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:8151:x1875552173565952:12345-192.168.201.25@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788666126.950068:0:5800:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788666126.950107:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788666126.950111:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788666126.950114:0:5800:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788666126.950117:0:5800:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788666126.954832:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:8151:x1875552173565952:12345-192.168.201.25@tcp:256:mount.lustre.0 Request processed in 4790us (5160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666126.954848:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 213 00000100:00100000:3.0:1788666126.958673:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666126.958828:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173566080 00000100:00100000:1.0:1788666126.958839:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173566080 00000100:00100000:1.0:1788666126.958912:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 214 00000100:00100000:1.0:1788666126.958921:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:8151:x1875552173566080:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788666126.958938:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666126.958973:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2a1d7de00/0x96bbe788361e9a5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d4282f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666126.958999:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2a1d7de00/0x96bbe788361e9a5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4282f expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666126.959011:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2a1d7de00/0x96bbe788361e9a5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4282f expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666126.959021:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2a1d7de00, rc 0) 00000100:00100000:1.0:1788666126.959082:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:8151:x1875552173566080:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 162us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666126.959090:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 214 00000100:00100000:3.0:1788666126.961684:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666126.961936:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173566208 00000100:00100000:2.0:1788666126.961947:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173566208 00000100:00100000:2.0:1788666126.962018:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 215 00000100:00100000:2.0:1788666126.962029:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298878050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:8151:x1875552173566208:12345-192.168.201.25@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788666126.962669:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298878050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:8151:x1875552173566208:12345-192.168.201.25@tcp:501:mount.lustre.0 Request processed in 639us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666126.962680:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 215 00000100:00100000:3.0:1788666126.964999:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666126.965098:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173566336 00000100:00100000:0.0:1788666126.965111:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173566336 00000100:00100000:0.0:1788666126.965176:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 216 00000100:00100000:0.0:1788666126.965186:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:8151:x1875552173566336:12345-192.168.201.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788666126.965644:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:8151:x1875552173566336:12345-192.168.201.25@tcp:503:mount.lustre.0 Request processed in 457us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666126.965652:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 216 00000100:00100000:3.0:1788666126.968750:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666126.968858:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173566464 00000100:00100000:1.0:1788666126.968869:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173566464 00000100:00100000:1.0:1788666126.968945:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 217 00000100:00100000:1.0:1788666126.968956:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:8159:x1875552173566464:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788666126.969242:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:8159:x1875552173566464:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 287us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666126.969251:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 217 00000100:00100000:3.0:1788666126.972080:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666126.972225:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173566592 00000100:00100000:0.0:1788666126.972235:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173566592 00000100:00100000:0.0:1788666126.972294:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 218 00000100:00100000:0.0:1788666126.972304:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:8159:x1875552173566592:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788666126.972609:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:8159:x1875552173566592:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 306us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666126.972618:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 218 00000100:00100000:3.0:1788666126.987396:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666126.987456:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666126.987931:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173566720 00000100:00100000:2.0:1788666126.987943:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173566720 00000100:00100000:2.0:1788666126.987990:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173567104 00000100:00100000:2.0:1788666126.987993:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173567104 00000100:00100000:2.0:1788666126.988045:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:2.0:1788666126.988053:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173567104:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666126.988125:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173567104:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 73us (669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666126.988133:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:2.0:1788666126.988149:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:2.0:1788666126.988153:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2357:x1875552173566720:12345-192.168.201.25@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788666126.988178:0:5810:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 84416489-fb20-4430-94f5-31470edbb54e@192.168.201.25@tcp t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:2.0:1788666126.988232:0:5810:0:(genops.c:1385:class_connect()) connect: client 84416489-fb20-4430-94f5-31470edbb54e, cookie 0x96bbe788361e9a65 00000004:00100000:2.0:1788666126.988272:0:5810:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788666126.988598:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788666126.989795:0:5810:0:(import.c:65:import_set_state_nolock()) ffff8ab2ae43b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788666126.990021:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84416489-fb20-4430-94f5-31470edbb54e+6:2357:x1875552173566720:12345-192.168.201.25@tcp:38:mount.lustre.0 Request processed in 1863us (2636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666126.990036:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:3.0:1788666126.997353:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666126.997470:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173566848 00000100:00100000:1.0:1788666126.997485:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173566848 00000100:00100000:1.0:1788666126.997635:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:1.0:1788666126.997645:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84416489-fb20-4430-94f5-31470edbb54e+6:0:x1875552173566848:12345-192.168.201.25@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788666126.997697:0:5808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788666126.997796:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84416489-fb20-4430-94f5-31470edbb54e+6:0:x1875552173566848:12345-192.168.201.25@tcp:41:mount.lustre.0 Request processed in 153us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666126.997820:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00080000:0.0:1788666126.997949:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666126.999259:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666126.999356:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173566976 00000100:00100000:0.0:1788666126.999367:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173566976 00000100:00100000:0.0:1788666126.999427:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:0.0:1788666126.999438:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84416489-fb20-4430-94f5-31470edbb54e+6:8151:x1875552173566976:12345-192.168.201.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788666126.999470:0:5810:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788666126.999559:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84416489-fb20-4430-94f5-31470edbb54e+6:8151:x1875552173566976:12345-192.168.201.25@tcp:41:mount.lustre.0 Request processed in 122us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666126.999567:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:2.0:1788666127.001849:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666127.001969:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173567232 00000100:00100000:1.0:1788666127.001981:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173567232 00000100:00100000:1.0:1788666127.002056:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:1.0:1788666127.002069:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84416489-fb20-4430-94f5-31470edbb54e+6:8151:x1875552173567232:12345-192.168.201.25@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788666127.002175:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84416489-fb20-4430-94f5-31470edbb54e+6:8151:x1875552173567232:12345-192.168.201.25@tcp:40:mount.lustre.0 Request processed in 109us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666127.002183:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:3.0:1788666127.011118:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666127.011167:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666127.011440:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173567360 00000100:00100000:0.0:1788666127.011451:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173567360 00000100:00100000:0.0:1788666127.011504:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:0.0:1788666127.011512:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2357:x1875552173567360:12345-192.168.201.25@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788666127.011558:0:8429:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 84416489-fb20-4430-94f5-31470edbb54e@192.168.201.25@tcp t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:0.0:1788666127.011626:0:8429:0:(genops.c:1385:class_connect()) connect: client 84416489-fb20-4430-94f5-31470edbb54e, cookie 0x96bbe788361e9a6c 00002000:00100000:0.0:1788666127.011638:0:8429:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 84416489-fb20-4430-94f5-31470edbb54e/ffff8ab2865e0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788666127.011668:0:8429:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788666127.012143:0:8429:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788666127.012179:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8ab2865e1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788666127.012327:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173567616 00000100:00100000:1.0:1788666127.012333:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173567616 00000100:00100000:1.0:1788666127.012373:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:1.0:1788666127.012393:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84416489-fb20-4430-94f5-31470edbb54e+6:8151:x1875552173567616:12345-192.168.201.25@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788666127.012477:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788666127.012703:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:84416489-fb20-4430-94f5-31470edbb54e+6:2357:x1875552173567360:12345-192.168.201.25@tcp:8:mount.lustre.0 Request processed in 1188us (1593us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666127.012714:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:1.0:1788666127.014270:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:84416489-fb20-4430-94f5-31470edbb54e+6:8151:x1875552173567616:12345-192.168.201.25@tcp:33:mount.lustre.0 Request processed in 1866us (3088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666127.014285:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:0.0:1788666127.014698:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666127.018049:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173567488 00000100:00100000:1.0:1788666127.018067:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173567488 00000100:00100000:1.0:1788666127.018134:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:1.0:1788666127.018144:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875552173567488:12345-192.168.201.25@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788666127.018183:0:6649:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 84416489-fb20-4430-94f5-31470edbb54e@192.168.201.25@tcp t0 exp 0000000000000000 cur 233 last 0 00000020:00000080:1.0:1788666127.018219:0:6649:0:(genops.c:1385:class_connect()) connect: client 84416489-fb20-4430-94f5-31470edbb54e, cookie 0x96bbe788361e9a73 00002000:00100000:1.0:1788666127.018232:0:6649:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 84416489-fb20-4430-94f5-31470edbb54e/ffff8ab28638d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788666127.018259:0:6649:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788666127.018628:0:6649:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788666127.018673:0:6649:0:(import.c:65:import_set_state_nolock()) ffff8ab28638b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788666127.018754:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:84416489-fb20-4430-94f5-31470edbb54e+6:2357:x1875552173567488:12345-192.168.201.25@tcp:8:mount.lustre.0 Request processed in 609us (4057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666127.018762:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 14 00000001:00100000:2.0:1788666127.335438:0:6678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 84416489-fb20-4430-94f5-31470edbb54e 00010000:00010000:3.0:1788666127.373841:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666128.395902:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666128.781290:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186182656:0@lo:400:kworker.0 00000100:00100000:1.0:1788666128.781389:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666128.784541:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186182784:0@lo:400:kworker.0 00000100:00100000:3.0:1788666128.784663:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666128.784764:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186183168:0@lo:400:kworker.0 00000100:00100000:1.0:1788666128.784796:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666128.784829:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788666128.784837:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186183040:0@lo:400:kworker.0 00000100:00100000:1.0:1788666128.784865:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666128.784923:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186182656 00000100:00100000:1.0:1788666128.784934:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186182656 00000100:00100000:1.0:1788666128.784993:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788666128.785003:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186182656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666128.785068:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186182656:12345-0@lo:400:kworker.0 Request processed in 66us (3679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666128.785075:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788666128.785110:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186182784 00000100:00100000:1.0:1788666128.785114:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186182784 00000100:00100000:1.0:1788666128.785137:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186183168 00000100:00100000:1.0:1788666128.785140:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186183168 00000100:00100000:1.0:1788666128.785170:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788666128.785177:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186182784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666128.785210:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186182784:12345-0@lo:400:kworker.0 Request processed in 34us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666128.785225:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788666128.785237:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788666128.785243:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186183168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666128.785271:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186183168:12345-0@lo:400:kworker.0 Request processed in 28us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666128.785277:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788666128.785280:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186183040 00000100:00100000:2.0:1788666128.785285:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186183040 00000100:00100000:1.0:1788666128.785314:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186182656:0@lo:400:kworker.0 00000100:00100000:2.0:1788666128.785327:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788666128.785327:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186183168:0@lo:400:kworker.0 00000100:00100000:2.0:1788666128.785333:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186183040:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788666128.785354:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788666128.785358:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666128.785372:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186183040:12345-0@lo:400:kworker.0 Request processed in 40us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666128.785378:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788666128.785378:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2aea3ca80 x1875552186183040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666128.785389:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186183040:0@lo:400:kworker.0 00000100:00100000:3.0:1788666128.785448:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186182784:0@lo:400:kworker.0 00000100:00100000:3.0:1788666128.785456:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186183296:0@lo:400:kworker.0 00000100:00100000:3.0:1788666128.785481:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666128.785556:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788666128.785564:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186182912:0@lo:400:kworker.0 00000100:00100000:3.0:1788666128.785613:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666128.785677:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186183296 00000100:00100000:1.0:1788666128.785681:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186183296 00000100:00100000:1.0:1788666128.785715:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788666128.785722:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186183296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666128.785761:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae279c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186183296:12345-0@lo:400:kworker.0 Request processed in 39us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666128.785766:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788666128.785780:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788666128.785799:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2ae278380 x1875552186183296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666144 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666128.785807:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186183296:0@lo:400:kworker.0 00000100:00100000:2.0:1788666128.786828:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186182912 00000100:00100000:2.0:1788666128.786840:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186182912 00000100:00100000:2.0:1788666128.786970:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788666128.786981:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186182912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666128.787067:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186182912:12345-0@lo:400:kworker.0 Request processed in 88us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666128.787074:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1788666128.787107:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788666128.787146:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186182912:0@lo:400:kworker.0 00000100:00100000:2.0:1788666129.299389:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666129.299420:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186183424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788666129.299520:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666129.299620:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186183424 00000100:00100000:2.0:1788666129.299628:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186183424 00000100:00100000:2.0:1788666129.299689:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788666129.299700:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186183424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788666129.299745:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666129.299798:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186183424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666129.299805:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788666129.299865:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2988ff480 x1875552186183424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666129.299887:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186183424:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788666129.419011:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666130.315259:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186183552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788666130.315339:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666130.315492:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186183552 00000100:00100000:2.0:1788666130.315502:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186183552 00000100:00100000:2.0:1788666130.315601:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788666130.315613:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b422b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186183552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788666130.315652:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666130.315699:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b422b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186183552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666130.315707:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788666130.315775:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788666130.315807:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bfaae680 x1875552186183552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666130.315827:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186183552:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788666130.442866:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788666131.406756:0:5830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 84416489-fb20-4430-94f5-31470edbb54e 00000001:00100000:1.0:1788666131.448173:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 84416489-fb20-4430-94f5-31470edbb54e 00010000:00010000:3.0:1788666131.467246:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666132.490669:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666132.500615:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666132.500658:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666132.500685:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666132.500708:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666132.500735:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666132.500766:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173568000 00000100:00100000:2.0:1788666132.500777:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173568000 00000100:00100000:3.0:1788666132.500975:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173567744 00000100:00100000:3.0:1788666132.500981:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173567744 00000100:00100000:3.0:1788666132.501026:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 220 00000100:00100000:3.0:1788666132.501036:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173567744:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666132.501108:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173567744:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 73us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666132.501116:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 220 00000100:00100000:3.0:1788666132.501153:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173567872 00000100:00100000:3.0:1788666132.501156:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173567872 00000100:00100000:3.0:1788666132.501186:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:3.0:1788666132.501193:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173567872:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666132.501224:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173567872:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 32us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666132.501231:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:2.0:1788666132.501409:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 65 00000100:00100000:2.0:1788666132.501417:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173568000:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666132.501459:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173568000:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 31us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666132.501465:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 65 00000100:00100000:2.0:1788666132.501485:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173568256 00000100:00100000:2.0:1788666132.501488:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173568256 00000100:00100000:2.0:1788666132.501511:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173568128 00000100:00100000:2.0:1788666132.501514:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173568128 00000100:00100000:2.0:1788666132.501531:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:2.0:1788666132.501537:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173568256:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666132.501560:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173568256:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 23us (875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666132.501566:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:2.0:1788666132.501575:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:2.0:1788666132.501604:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173568128:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666132.501625:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173568128:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 45us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666132.501630:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00080000:2.0:1788666132.501644:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788666132.501647:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788666132.501649:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:0.0:1788666132.663429:0:10279:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1788666133.519087:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666133.902642:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186183808:0@lo:400:kworker.0 00000100:00100000:2.0:1788666133.902713:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666133.902756:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186183808 00000100:00100000:2.0:1788666133.902777:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186184320:0@lo:400:kworker.0 00000100:00100000:2.0:1788666133.902817:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666133.902846:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666133.902852:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186183936:0@lo:400:kworker.0 00000100:00100000:2.0:1788666133.902874:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666133.902878:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186183808 00000100:00100000:2.0:1788666133.902909:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186184320 00000100:00100000:2.0:1788666133.902913:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186184320 00000100:00100000:3.0:1788666133.902925:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186183936 00000100:00100000:3.0:1788666133.902928:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186183936 00000100:00100000:3.0:1788666133.902947:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788666133.902947:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788666133.902955:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186183808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666133.902955:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae22f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186184320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666133.903011:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186183808:12345-0@lo:400:kworker.0 Request processed in 57us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666133.903018:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788666133.903036:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788666133.903042:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186183936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666133.903102:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186183680:0@lo:400:kworker.0 00000100:00100000:1.0:1788666133.903293:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666133.903320:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186184192:0@lo:400:kworker.0 00000100:00100000:1.0:1788666133.903343:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666133.903356:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788666133.903361:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186184064:0@lo:400:kworker.0 00000100:00100000:1.0:1788666133.903384:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666133.903416:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186183680 00000100:00100000:1.0:1788666133.903431:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186183680 00000100:00100000:1.0:1788666133.903463:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788666133.903470:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186183680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666133.903505:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186183680:12345-0@lo:400:kworker.0 Request processed in 35us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666133.903511:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788666133.903548:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186184064 00000100:00100000:1.0:1788666133.903551:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186184064 00000100:00100000:1.0:1788666133.903575:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788666133.903599:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186184064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666133.903630:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186184064:12345-0@lo:400:kworker.0 Request processed in 50us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666133.903636:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788666133.903671:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bfaadc00 x1875552186184064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666133.903689:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186184064:0@lo:400:kworker.0 00000100:00100000:1.0:1788666133.903697:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186183680:0@lo:400:kworker.0 00000100:00100000:2.0:1788666133.903889:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae22f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186184320:12345-0@lo:400:kworker.0 Request processed in 934us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666133.903897:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788666133.904038:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186184192 00000100:00100000:2.0:1788666133.904043:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186184192 00000100:00100000:2.0:1788666133.904063:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788666133.904070:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186184192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666133.904107:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186184192:12345-0@lo:400:kworker.0 Request processed in 38us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666133.904133:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1788666133.904153:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788666133.904158:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788666133.904160:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788666133.904849:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186184192:0@lo:400:kworker.0 00000100:00100000:3.0:1788666133.905677:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186183936:12345-0@lo:400:kworker.0 Request processed in 2629us (2795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666133.905693:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788666133.905845:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186183936:0@lo:400:kworker.0 00000100:00100000:2.0:1788666133.905859:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186183808:0@lo:400:kworker.0 00010000:00080000:2.0:1788666133.905875:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bfaad880 x1875552186184320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666133.905885:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186184320:0@lo:400:kworker.0 00000100:00100000:3.0:1788666134.410804:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186184448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788666134.410897:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666134.411155:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186184448 00000100:00100000:2.0:1788666134.411164:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186184448 00000100:00100000:2.0:1788666134.411225:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788666134.411236:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186184448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788666134.411279:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666134.411347:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186184448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666134.411355:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1788666134.411396:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2c1b7ce00 x1875552186184448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666134.411424:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186184448:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788666134.547035:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666135.434819:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788666135.434844:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186184576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788666135.434917:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666135.435004:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186184576 00000100:00100000:1.0:1788666135.435013:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186184576 00000100:00100000:1.0:1788666135.435082:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788666135.435092:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186184576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788666135.435129:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666135.435176:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186184576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666135.435184:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788666135.435210:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788666135.435243:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2aea3dc00 x1875552186184576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666151 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666135.435281:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186184576:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788666135.570131:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666136.590850:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666137.605374:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666137.605433:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666137.605465:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666137.605495:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666137.605524:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173568512 00000100:00100000:2.0:1788666137.605534:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173568512 00000100:00100000:2.0:1788666137.605625:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173568640 00000100:00100000:2.0:1788666137.605629:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173568640 00000100:00100000:2.0:1788666137.605656:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:2.0:1788666137.605667:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173568512:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666137.605741:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173568512:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 76us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666137.605749:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:2.0:1788666137.605766:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 70 00000100:00100000:2.0:1788666137.605790:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84416489-fb20-4430-94f5-31470edbb54e+5:2363:x1875552173568640:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666137.605815:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84416489-fb20-4430-94f5-31470edbb54e+5:2363:x1875552173568640:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 27us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666137.605822:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 70 00000100:00100000:2.0:1788666137.605842:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173568768 00000100:00100000:2.0:1788666137.605845:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173568768 00000100:00100000:2.0:1788666137.605871:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:2.0:1788666137.605877:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84416489-fb20-4430-94f5-31470edbb54e+5:2363:x1875552173568768:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666137.605915:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84416489-fb20-4430-94f5-31470edbb54e+5:2363:x1875552173568768:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 37us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666137.605921:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00080000:2.0:1788666137.605937:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788666137.605943:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666137.606526:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173568384 00000100:00100000:3.0:1788666137.606534:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173568384 00000100:00100000:3.0:1788666137.606568:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 222 00000100:00100000:3.0:1788666137.606577:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2363:x1875552173568384:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666137.606637:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2363:x1875552173568384:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 62us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666137.606644:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 222 00000100:00100000:2.0:1788666137.606901:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666137.607247:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173568896 00000100:00100000:3.0:1788666137.607253:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173568896 00000100:00100000:3.0:1788666137.607307:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:3.0:1788666137.607315:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173568896:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666137.607542:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173568896:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 227us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666137.607550:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00080000:2.0:1788666137.607790:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788666137.618576:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666138.636139:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666139.019061:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186184960:0@lo:400:kworker.0 00000100:00100000:2.0:1788666139.019140:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666139.019218:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788666139.019226:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875552186184832:0@lo:400:kworker.0 00000100:00100000:1.0:1788666139.019252:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186184704:0@lo:400:kworker.0 00000100:00100000:2.0:1788666139.019253:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666139.019276:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186185344:0@lo:400:kworker.0 00000100:00100000:0.0:1788666139.019368:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186185088:0@lo:400:kworker.0 00000100:00100000:3.0:1788666139.019398:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186184960 00000100:00100000:3.0:1788666139.019407:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186184960 00000100:00100000:3.0:1788666139.019466:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186184832 00000100:00100000:3.0:1788666139.019470:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186184832 00000100:00100000:3.0:1788666139.019498:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788666139.019509:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186184960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666139.019926:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666139.019971:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788666139.019980:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875552186184832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666139.020023:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae726300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875552186184832:12345-0@lo:400:kworker.0 Request processed in 45us (770us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666139.020038:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788666139.020065:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666139.020081:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186185344 00000100:00100000:2.0:1788666139.020086:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186185344 00000100:00100000:2.0:1788666139.020122:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788666139.020128:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186185344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666139.020162:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186185344:12345-0@lo:400:kworker.0 Request processed in 34us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666139.020168:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1788666139.020188:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788666139.020229:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875552186184832:0@lo:400:kworker.0 00010000:00080000:2.0:1788666139.020244:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2b46b4380 x1875552186185344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666139.020254:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186185344:0@lo:400:kworker.0 00000100:00100000:1.0:1788666139.026793:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666139.026877:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186185216:0@lo:400:kworker.0 00000100:00100000:1.0:1788666139.026949:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666139.027030:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186185216 00000100:00100000:1.0:1788666139.027041:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186185216 00000100:00100000:1.0:1788666139.027106:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788666139.027129:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186185216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666139.027208:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186185216:12345-0@lo:400:kworker.0 Request processed in 93us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666139.027216:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788666139.030711:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666139.030802:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186185088 00000100:00100000:0.0:1788666139.030813:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186185088 00000100:00080000:1.0:1788666139.030860:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788666139.030867:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666139.030879:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788666139.030893:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186185088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666139.030916:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186185216:0@lo:400:kworker.0 00000100:00100000:0.0:1788666139.030978:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186185088:12345-0@lo:400:kworker.0 Request processed in 88us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666139.030987:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788666139.030990:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2b46b5f80 x1875552186185088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666139.031003:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186185088:0@lo:400:kworker.0 00000100:00100000:2.0:1788666139.031113:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186184704 00000100:00100000:2.0:1788666139.031118:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186184704 00000100:00100000:2.0:1788666139.031161:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1788666139.031169:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186184704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666139.031238:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186184704:12345-0@lo:400:kworker.0 Request processed in 70us (4457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666139.031245:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788666139.031596:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186184960:12345-0@lo:400:kworker.0 Request processed in 12070us (12436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666139.031606:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788666139.031786:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186184960:0@lo:400:kworker.0 00000100:00100000:0.0:1788666139.033462:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186184704:0@lo:400:kworker.0 00000100:00100000:2.0:1788666139.533618:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae27b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186185472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788666139.533709:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666139.534341:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186185472 00000100:00100000:1.0:1788666139.534354:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186185472 00000100:00100000:1.0:1788666139.535412:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788666139.535429:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186185472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788666139.535482:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666139.538781:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186185472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3350us (5064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666139.538805:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788666139.539204:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2ae27b480 x1875552186185472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666139.539233:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae27b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186185472:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788666139.661780:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666140.560092:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788666140.560119:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186185600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788666140.560192:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666140.560871:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186185600 00000100:00100000:2.0:1788666140.560885:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186185600 00000100:00100000:2.0:1788666140.560958:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788666140.560970:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186185600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788666140.561179:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666140.561261:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186185600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 292us (1067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666140.561269:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788666140.561399:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2ae726a00 x1875552186185600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666156 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666140.561421:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186185600:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788666140.685979:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666141.722201:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666142.730859:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666142.730917:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666142.730949:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666142.730971:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666142.731009:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666142.731081:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173569152 00000100:00100000:2.0:1788666142.731094:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173569152 00000100:00100000:2.0:1788666142.731182:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173569280 00000100:00100000:2.0:1788666142.731186:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173569280 00000100:00100000:2.0:1788666142.731231:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 74 00000100:00100000:2.0:1788666142.731243:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173569152:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666142.731349:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae725f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173569152:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 109us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666142.731360:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 74 00000100:00100000:2.0:1788666142.731383:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 75 00000100:00100000:2.0:1788666142.731412:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173569280:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666142.731442:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173569280:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 33us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666142.731448:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 75 00000100:00100000:2.0:1788666142.731470:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173569408 00000100:00100000:2.0:1788666142.731473:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173569408 00000100:00100000:2.0:1788666142.731505:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173569536 00000100:00100000:2.0:1788666142.731508:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173569536 00000100:00100000:2.0:1788666142.731537:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:2.0:1788666142.731543:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84416489-fb20-4430-94f5-31470edbb54e+5:2363:x1875552173569408:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666142.731608:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae726a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84416489-fb20-4430-94f5-31470edbb54e+5:2363:x1875552173569408:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 65us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666142.731616:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:2.0:1788666142.731641:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:2.0:1788666142.731648:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173569536:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666142.731672:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173569536:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 25us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666142.731678:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:3.0:1788666142.732824:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173569024 00000100:00100000:3.0:1788666142.732836:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173569024 00000100:00100000:3.0:1788666142.732898:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 224 00000100:00100000:3.0:1788666142.732906:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173569024:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666142.732956:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173569024:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 52us (2115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666142.732963:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 224 00000100:00080000:1.0:1788666142.734542:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788666142.734552:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788666142.734555:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788666142.735126:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666143.754888:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666144.141305:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186186112:0@lo:400:kworker.0 00000100:00100000:2.0:1788666144.141403:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666144.141468:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788666144.141475:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186185728:0@lo:400:kworker.0 00000100:00100000:2.0:1788666144.141508:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666144.141554:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186186240:0@lo:400:kworker.0 00000100:00100000:2.0:1788666144.141616:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666144.141643:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186185856:0@lo:400:kworker.0 00000100:00100000:2.0:1788666144.141668:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666144.141687:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186186368:0@lo:400:kworker.0 00000100:00100000:2.0:1788666144.141708:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666144.141727:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666144.141733:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186185984:0@lo:400:kworker.0 00000100:00100000:2.0:1788666144.141756:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666144.141804:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186186112 00000100:00100000:2.0:1788666144.141813:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186186112 00000100:00100000:2.0:1788666144.141871:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186186368 00000100:00100000:2.0:1788666144.141874:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186186368 00000100:00100000:2.0:1788666144.141902:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788666144.141913:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186186112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666144.141974:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186186112:12345-0@lo:400:kworker.0 Request processed in 62us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666144.141983:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788666144.142000:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788666144.142007:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186186368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666144.142039:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae843480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186186368:12345-0@lo:400:kworker.0 Request processed in 32us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666144.142045:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788666144.142063:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186185728 00000100:00100000:2.0:1788666144.142066:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186185728 00000100:00100000:2.0:1788666144.142092:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788666144.142098:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186185728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666144.142132:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186185728:12345-0@lo:400:kworker.0 Request processed in 35us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666144.142138:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788666144.142164:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186186240 00000100:00100000:2.0:1788666144.142167:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186186240 00000100:00100000:2.0:1788666144.142190:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186185856 00000100:00100000:2.0:1788666144.142193:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186185856 00000100:00100000:2.0:1788666144.142201:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186185984 00000100:00100000:2.0:1788666144.142203:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186185984 00000100:00100000:2.0:1788666144.142221:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788666144.142226:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186186240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666144.142268:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186186240:12345-0@lo:400:kworker.0 Request processed in 41us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666144.142273:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788666144.142284:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788666144.142290:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186185856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666144.142314:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae840e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186185856:12345-0@lo:400:kworker.0 Request processed in 25us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666144.142320:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788666144.142330:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788666144.142336:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186185984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666144.142364:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186185984:12345-0@lo:400:kworker.0 Request processed in 29us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666144.142370:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1788666144.142402:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788666144.142408:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788666144.142410:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788666144.142473:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186185984:0@lo:400:kworker.0 00000100:00100000:2.0:1788666144.142486:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186185856:0@lo:400:kworker.0 00010000:00080000:2.0:1788666144.142500:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2ae841c00 x1875552186186368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666144.142510:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae841c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186186368:0@lo:400:kworker.0 00000100:00100000:2.0:1788666144.142652:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186185728:0@lo:400:kworker.0 00000100:00100000:2.0:1788666144.142664:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186186240:0@lo:400:kworker.0 00010000:00080000:2.0:1788666144.142674:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2ae843100 x1875552186186112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666144.142683:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186186112:0@lo:400:kworker.0 00000100:00100000:3.0:1788666144.655633:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186186496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788666144.656557:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666144.656813:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186186496 00000100:00100000:0.0:1788666144.656824:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186186496 00000100:00100000:1.0:1788666144.657805:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788666144.657819:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186186496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788666144.657862:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666144.657937:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186186496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666144.657944:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788666144.658891:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2aea3fb80 x1875552186186496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666160 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666144.658924:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186186496:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788666144.780554:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666145.689632:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788666145.689696:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab18253f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186186624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788666145.689776:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666145.690035:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186186624 00000100:00100000:0.0:1788666145.690045:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186186624 00000100:00100000:0.0:1788666145.690107:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788666145.690118:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186186624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788666145.690159:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666145.690206:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186186624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666145.690213:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788666145.692174:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab18253f480 x1875552186186624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666145.692203:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab18253f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186186624:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788666145.803823:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666146.836992:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666147.844040:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666147.844141:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173569664 00000100:00100000:1.0:1788666147.844151:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173569664 00000100:00100000:1.0:1788666147.844223:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 226 00000100:00100000:1.0:1788666147.844234:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2363:x1875552173569664:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666147.844308:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2363:x1875552173569664:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 75us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666147.844319:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 226 00000100:00100000:3.0:1788666147.852044:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666147.852097:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666147.852129:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666147.852155:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666147.852208:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173569792 00000100:00100000:3.0:1788666147.852221:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173569792 00000100:00100000:3.0:1788666147.852299:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173569920 00000100:00100000:3.0:1788666147.852302:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173569920 00000100:00100000:3.0:1788666147.852344:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:3.0:1788666147.852355:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae27a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173569792:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666147.852448:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae27a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173569792:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 95us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666147.852457:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:3.0:1788666147.852474:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 80 00000100:00100000:3.0:1788666147.852481:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173569920:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666147.852504:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173569920:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 25us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666147.852511:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 80 00000100:00100000:3.0:1788666147.852531:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173570048 00000100:00100000:3.0:1788666147.852534:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173570048 00000100:00100000:3.0:1788666147.852560:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173570176 00000100:00100000:3.0:1788666147.852562:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173570176 00000100:00100000:3.0:1788666147.852615:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:3.0:1788666147.852623:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae27a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84416489-fb20-4430-94f5-31470edbb54e+5:2357:x1875552173570048:12345-192.168.201.25@tcp:9:kworker.0 00000020:00000080:3.0:1788666147.852642:0:6651:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e9a6c 00000100:00080000:3.0:1788666147.852650:0:6651:0:(import.c:65:import_set_state_nolock()) ffff8ab2865e1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788666147.852689:0:6651:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788666147.853036:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae27a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84416489-fb20-4430-94f5-31470edbb54e+2:2357:x1875552173570048:12345-192.168.201.25@tcp:9:kworker.0 Request processed in 413us (905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666147.853044:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:3.0:1788666147.853059:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:3.0:1788666147.853066:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84416489-fb20-4430-94f5-31470edbb54e+5:2357:x1875552173570176:12345-192.168.201.25@tcp:9:kworker.0 00000020:00000080:3.0:1788666147.853079:0:6651:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e9a73 00000100:00080000:3.0:1788666147.853096:0:6651:0:(import.c:65:import_set_state_nolock()) ffff8ab28638b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788666147.853119:0:6651:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788666147.853342:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae279180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:84416489-fb20-4430-94f5-31470edbb54e+2:2357:x1875552173570176:12345-192.168.201.25@tcp:9:kworker.0 Request processed in 277us (1185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666147.853350:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00080000:3.0:1788666147.853376:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788666147.853380:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788666147.853382:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788666147.853516:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666147.853523:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666147.864217:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666148.875750:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666149.259242:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186186752:0@lo:400:kworker.0 00000100:00100000:1.0:1788666149.259350:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666149.259455:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186186752 00000100:00100000:3.0:1788666149.259465:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186186752 00000100:00100000:3.0:1788666149.259532:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788666149.259542:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186186752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666149.261749:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186187136:0@lo:400:kworker.0 00000100:00100000:2.0:1788666149.261835:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666149.262018:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186186752:12345-0@lo:400:kworker.0 Request processed in 2475us (2667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666149.262028:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788666149.262086:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186187008:0@lo:400:kworker.0 00000100:00100000:3.0:1788666149.262112:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666149.262139:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788666149.262144:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875552186186880:0@lo:400:kworker.0 00000100:00100000:3.0:1788666149.262175:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666149.262202:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186187136 00000100:00100000:3.0:1788666149.262209:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186187136 00000100:00100000:3.0:1788666149.262256:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788666149.262268:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186187136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666149.262316:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186187136:12345-0@lo:400:kworker.0 Request processed in 53us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666149.262333:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788666149.262351:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186187008 00000100:00100000:3.0:1788666149.262354:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186187008 00000100:00100000:3.0:1788666149.262376:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186186880 00000100:00100000:3.0:1788666149.262379:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186186880 00000100:00100000:3.0:1788666149.262398:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788666149.262404:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae27ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186187008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666149.262438:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae27ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186187008:12345-0@lo:400:kworker.0 Request processed in 35us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666149.262444:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788666149.262454:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788666149.262459:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae27b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875552186186880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666149.262483:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae27b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875552186186880:12345-0@lo:400:kworker.0 Request processed in 24us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666149.262487:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1788666149.262500:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788666149.262504:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788666149.262549:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875552186186880:0@lo:400:kworker.0 00000100:00100000:3.0:1788666149.262558:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186187008:0@lo:400:kworker.0 00010000:00080000:2.0:1788666149.262803:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2988ffb80 x1875552186187136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666149.262816:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186187136:0@lo:400:kworker.0 00000100:00100000:0.0:1788666149.262959:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186187392:0@lo:400:kworker.0 00000100:00100000:0.0:1788666149.262996:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666149.263029:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186187392 00000100:00100000:0.0:1788666149.263040:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186187392 00000100:00100000:0.0:1788666149.263203:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788666149.263211:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186187392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666149.263251:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186187392:12345-0@lo:400:kworker.0 Request processed in 42us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666149.263257:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1788666149.263286:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2988fe680 x1875552186187392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666149.263296:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186187392:0@lo:400:kworker.0 00000100:00080000:2.0:1788666149.263349:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788666149.263384:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788666149.263393:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186187264:0@lo:400:kworker.0 00000100:00100000:3.0:1788666149.263418:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666149.263472:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186187264 00000100:00100000:2.0:1788666149.263476:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186187264 00000100:00100000:2.0:1788666149.263524:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788666149.263532:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae27b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186187264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666149.263566:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae27b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186187264:12345-0@lo:400:kworker.0 Request processed in 35us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666149.263572:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788666149.263705:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666149.263723:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186187264:0@lo:400:kworker.0 00000100:00100000:1.0:1788666149.263829:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186186752:0@lo:400:kworker.0 00000100:00100000:2.0:1788666149.771561:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666149.771763:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186187520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788666149.771875:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666149.772204:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186187520 00000100:00100000:1.0:1788666149.772215:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186187520 00000100:00100000:1.0:1788666149.772279:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788666149.772289:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186187520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788666149.772328:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666149.772397:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186187520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666149.772405:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1788666149.772559:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2aea3fb80 x1875552186187520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666165 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666149.772622:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186187520:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788666149.899222:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666150.794990:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186187648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788666150.795074:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666150.795388:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186187648 00000100:00100000:0.0:1788666150.795398:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186187648 00000100:00100000:0.0:1788666150.795459:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788666150.795470:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae279880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186187648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788666150.795534:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666150.795622:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae279880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186187648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666150.795630:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788666150.796022:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2ae843100 x1875552186187648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666150.796040:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186187648:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788666150.928710:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788666151.885244:0:10980:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1788666151.895702:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 84416489-fb20-4430-94f5-31470edbb54e 00000020:00000080:1.0:1788666151.895715:0:7606:0:(genops.c:885:class_export_put()) final put ffff8ab28638d000/84416489-fb20-4430-94f5-31470edbb54e 00000020:00000080:2.0:1788666151.895835:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab28638d000/84416489-fb20-4430-94f5-31470edbb54e for lustre-OST0001 00000020:00000080:2.0:1788666151.895892:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab28638b000 for lustre-OST0001 00010000:00010000:3.0:1788666151.951255:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666152.967858:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666152.967903:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666152.967941:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666152.968185:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173570560 00000100:00100000:0.0:1788666152.968198:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173570560 00000100:00100000:0.0:1788666152.968280:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173570432 00000100:00100000:0.0:1788666152.968284:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173570432 00000100:00100000:3.0:1788666152.968285:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173570304 00000100:00100000:3.0:1788666152.968292:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173570304 00000100:00100000:0.0:1788666152.968336:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 84 00000100:00100000:3.0:1788666152.968337:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 228 00000100:00100000:3.0:1788666152.968351:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2362:x1875552173570304:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666152.968355:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84416489-fb20-4430-94f5-31470edbb54e+5:2362:x1875552173570560:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666152.968431:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2362:x1875552173570304:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 83us (587us total) trans 0 rc 0/0 00000100:00080000:1.0:1788666152.968466:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788666152.968495:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 85 00000100:00100000:3.0:1788666152.968502:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 228 00000100:00100000:1.0:1788666152.968507:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2362:x1875552173570432:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666152.969474:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84416489-fb20-4430-94f5-31470edbb54e+5:2362:x1875552173570560:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 1120us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666152.969486:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 84 00000100:00100000:1.0:1788666152.969565:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2362:x1875552173570432:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 1062us (1622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666152.969573:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 85 00010000:00010000:2.0:1788666152.973776:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788666152.979408:0:6678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 84416489-fb20-4430-94f5-31470edbb54e 00000020:00000080:2.0:1788666152.979418:0:6678:0:(genops.c:885:class_export_put()) final put ffff8ab2865e0000/84416489-fb20-4430-94f5-31470edbb54e 00000020:00000080:1.0:1788666152.979772:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2865e0000/84416489-fb20-4430-94f5-31470edbb54e for lustre-OST0000 00000020:00000080:1.0:1788666152.979834:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab2865e1000 for lustre-OST0000 00010000:00010000:3.0:1788666153.998293:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666154.390044:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186188160:0@lo:400:kworker.0 00000100:00100000:1.0:1788666154.390160:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666154.390233:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788666154.390239:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186187776:0@lo:400:kworker.0 00000100:00100000:1.0:1788666154.390270:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666154.390296:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186188288:0@lo:400:kworker.0 00000100:00100000:1.0:1788666154.390324:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666154.390352:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186187904:0@lo:400:kworker.0 00000100:00100000:1.0:1788666154.390377:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666154.390412:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186188416:0@lo:400:kworker.0 00000100:00100000:1.0:1788666154.390941:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666154.390982:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788666154.390989:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186188032:0@lo:400:kworker.0 00000100:00100000:1.0:1788666154.391012:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666154.391051:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186188160 00000100:00100000:1.0:1788666154.391077:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186188160 00000100:00100000:1.0:1788666154.391142:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186188416 00000100:00100000:1.0:1788666154.391145:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186188416 00000100:00100000:1.0:1788666154.391166:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788666154.391176:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186188160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666154.391237:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186188160:12345-0@lo:400:kworker.0 Request processed in 63us (1078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666154.391245:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788666154.391262:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788666154.391268:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186188416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666154.391293:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186188416:12345-0@lo:400:kworker.0 Request processed in 26us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666154.391298:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788666154.391315:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186187776 00000100:00100000:1.0:1788666154.391318:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186187776 00000100:00100000:1.0:1788666154.391341:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788666154.391346:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186187776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666154.391370:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186187776:12345-0@lo:400:kworker.0 Request processed in 24us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666154.391375:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788666154.391400:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186188288 00000100:00100000:1.0:1788666154.391412:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186188288 00000100:00100000:1.0:1788666154.391723:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186187904 00000100:00100000:1.0:1788666154.391728:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186187904 00000100:00100000:3.0:1788666154.397551:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186188032 00000100:00100000:3.0:1788666154.397572:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186188032 00000100:00100000:3.0:1788666154.397651:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788666154.397664:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186188288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666154.397783:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186188288:12345-0@lo:400:kworker.0 Request processed in 122us (7458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666154.397791:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788666154.397810:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788666154.397818:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186187904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666154.397849:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186187904:12345-0@lo:400:kworker.0 Request processed in 33us (7472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666154.397867:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788666154.397879:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788666154.397885:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186188032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666154.397918:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186188032:12345-0@lo:400:kworker.0 Request processed in 34us (6904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666154.397924:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1788666154.407150:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788666154.407165:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788666154.407169:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788666154.407250:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186188032:0@lo:400:kworker.0 00000100:00100000:1.0:1788666154.407267:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186187904:0@lo:400:kworker.0 00010000:00080000:1.0:1788666154.407282:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bfaac380 x1875552186188416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666154.407292:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186188416:0@lo:400:kworker.0 00000100:00100000:1.0:1788666154.407334:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186187776:0@lo:400:kworker.0 00000100:00100000:1.0:1788666154.407347:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186188288:0@lo:400:kworker.0 00010000:00080000:1.0:1788666154.407359:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bfaaf100 x1875552186188160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666154.407368:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186188160:0@lo:400:kworker.0 00000100:00100000:0.0:1788666154.892676:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186188544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788666154.892795:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666154.892922:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186188544 00000100:00100000:0.0:1788666154.892935:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186188544 00000100:00100000:0.0:1788666154.893001:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788666154.893011:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186188544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788666154.893057:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666154.893114:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186188544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666154.893121:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788666154.893167:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2988fe680 x1875552186188544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666170 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666154.893186:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186188544:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788666155.019704:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666155.917269:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788666155.917306:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186188672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788666155.917408:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666155.917498:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186188672 00000100:00100000:2.0:1788666155.917506:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186188672 00000100:00100000:2.0:1788666155.917556:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788666155.917568:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186188672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788666155.917630:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666155.917684:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae841c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186188672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666155.917713:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788666155.917775:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2ae841f80 x1875552186188672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666155.917796:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186188672:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788666156.043248:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666157.067494:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788666157.176998:0:11131:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe3b3e0be0 20000000:00000080:3.0:1788666157.177016:0:11131:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab2bc3e1800 uarg=0000000000000000 20000000:01000000:3.0:1788666157.177080:0:11131:0:(mgs_llog.c:6191:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788666157.177088:0:11131:0:(mgs_llog.c:4646:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788666157.177093:0:11131:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788666157.178851:0:11132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788666157.179113:0:11131:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788666157.197095:0:11131:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788666157.197145:0:11131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a7a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666157.197181:0:11131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e9a1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427f7 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666157.197193:0:11131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab2814ff400/0x96bbe788361e9a2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9a26 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666157.197201:0:11131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab2a1d7c400/0x96bbe788361e9a3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9a34 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666157.197208:0:11131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab28144a800/0x96bbe788361e9a49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9a42 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666157.197231:0:11131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab2a1d7de00/0x96bbe788361e9a5e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4282f expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666157.197241:0:11131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a7a lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666157.197303:0:11131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab2a1d7de00/0x96bbe788361e9a5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4282f expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666157.197324:0:11131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab2a1d7de00/0x96bbe788361e9a5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4282f expref: 12 pid: 5802 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666157.197344:0:11131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae278700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11131:1875552186188800:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788666157.203264:0:11131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab28144a800/0x96bbe788361e9a49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e9a42 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666157.203291:0:11131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab28144a800/0x96bbe788361e9a49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e9a42 expref: 18 pid: 5802 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666157.203312:0:11131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae27aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11131:1875552186188928:0@lo:104: 00000100:00100000:3.0:1788666157.204636:0:11131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788666157.204735:0:11131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab2a1d7c400/0x96bbe788361e9a3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e9a34 expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666157.204750:0:11131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab2a1d7c400/0x96bbe788361e9a3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e9a34 expref: 18 pid: 5800 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666157.204764:0:11131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae279c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11131:1875552186189056:0@lo:104: 00000100:00100000:3.0:1788666157.204817:0:11131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788666157.204851:0:11131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab2814ff400/0x96bbe788361e9a2d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e9a26 expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666157.204862:0:11131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab2814ff400/0x96bbe788361e9a2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e9a26 expref: 18 pid: 5801 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666157.204872:0:11131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae278a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11131:1875552186189184:0@lo:104: 00000100:00100000:2.0:1788666157.204878:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186188928 00000100:00100000:2.0:1788666157.204889:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186188928 00000100:00100000:3.0:1788666157.204929:0:11131:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666157.204946:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186189056 00000100:00100000:2.0:1788666157.204949:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186189056 00010000:00010000:3.0:1788666157.204962:0:11131:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e9a1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427f7 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666157.204963:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186189184 00000100:00100000:2.0:1788666157.204967:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186189184 00010000:00010000:3.0:1788666157.204980:0:11131:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e9a1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427f7 expref: 12 pid: 5800 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666157.204988:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788666157.204996:0:11131:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa63800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11131:1875552186189312:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788666157.205000:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae27b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+5:11131:x1875552186188928:12345-0@lo:104: 00010000:00010000:2.0:1788666157.205018:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9a49 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666157.205083:0:11131:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bbe86900 going to sleep for 11 seconds 00010000:00010000:2.0:1788666157.205102:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788666157.205111:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae27b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+5:11131:x1875552186188928:12345-0@lo:104: Request processed in 113us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666157.205117:0:11131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae27aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11131:1875552186188928:0@lo:104: 00000100:00100000:2.0:1788666157.205124:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788666157.205149:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788666157.205156:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae278380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+4:11131:x1875552186189056:12345-0@lo:104: 00010000:00010000:2.0:1788666157.205164:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab28144b400/0x96bbe788361e9a34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9a3b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.205206:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788666157.205211:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae278380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+4:11131:x1875552186189056:12345-0@lo:104: Request processed in 57us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666157.205228:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788666157.205239:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788666157.205244:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+3:11131:x1875552186189184:12345-0@lo:104: 00010000:00010000:2.0:1788666157.205252:0:5791:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9a26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9a2d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.205282:0:5791:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788666157.205287:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:633727f4-1aad-4438-919b-34cfb144e459+3:11131:x1875552186189184:12345-0@lo:104: Request processed in 43us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666157.205293:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788666157.205308:0:7593:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788666157.205313:0:7593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9a49 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.205321:0:7593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7d200 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:2.0:1788666157.205326:0:7593:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e9a49 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.205337:0:7593:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e9a49 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788666157.205345:0:7593:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e9a49 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666157.205351:0:7593:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788666157.205390:0:7593:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9a49 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.205403:0:7593:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788666157.205432:0:7593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a42 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9a49 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.205439:0:7593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9a49 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.205453:0:7593:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788666157.205456:0:7593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab28144b400/0x96bbe788361e9a34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9a3b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.205462:0:7593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144b400 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:2.0:1788666157.205465:0:7593:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab28144b400/0x96bbe788361e9a34 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e9a3b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.205472:0:7593:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab28144b400/0x96bbe788361e9a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e9a3b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788666157.205479:0:7593:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab28144b400/0x96bbe788361e9a34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e9a3b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666157.205483:0:7593:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788666157.205498:0:7593:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab28144b400/0x96bbe788361e9a34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9a3b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.205504:0:7593:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788666157.205521:0:7593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab28144b400/0x96bbe788361e9a34 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9a3b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.205527:0:7593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab28144b400/0x96bbe788361e9a34 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9a3b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.205535:0:7593:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666157.205543:0:7593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9a26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9a2d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.205549:0:7593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd5600 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:2.0:1788666157.205552:0:7593:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9a26 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e9a2d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.205559:0:7593:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9a26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e9a2d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788666157.205564:0:7593:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9a26 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e9a2d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666157.205570:0:7593:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788666157.205607:0:7593:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9a26 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9a2d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.205614:0:7593:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788666157.205620:0:7593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9a26 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9a2d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.205625:0:7593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5600/0x96bbe788361e9a26 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9a2d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.205640:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666157.205642:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666157.205644:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666157.205651:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666157.205656:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666157.205669:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186189440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788666157.205705:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666157.205758:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186189568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788666157.207284:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666157.207352:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666157.207366:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186189696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788666157.207569:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666157.207633:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186189440 00000100:00100000:2.0:1788666157.207642:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186189440 00010000:00010000:2.0:1788666157.207693:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab28144a800/0x96bbe788361e9a49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9a42 expref: 19 pid: 5802 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666157.207888:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186189568 00000100:00100000:0.0:1788666157.207892:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186189568 00010000:00010000:0.0:1788666157.207911:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab2a1d7c400/0x96bbe788361e9a3b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9a34 expref: 20 pid: 5800 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666157.207926:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186189696 00000100:00100000:0.0:1788666157.207928:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186189696 00010000:00010000:0.0:1788666157.207940:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab2814ff400/0x96bbe788361e9a2d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9a26 expref: 21 pid: 5801 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666157.207977:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788666157.207988:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b9dd0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+21:3276:x1875552186189440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788666157.208007:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666157.208014:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab28144a800/0x96bbe788361e9a49 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9a42 expref: 21 pid: 5802 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666157.208037:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab28144a800/0x96bbe788361e9a49 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e9a42 expref: 21 pid: 5802 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666157.208061:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab28144a800/0x96bbe788361e9a49 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e9a42 expref: 21 pid: 5802 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666157.208079:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666157.208138:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b9dd0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+20:3276:x1875552186189440:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (2431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666157.208145:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788666157.208203:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788666157.208209:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+19:3277:x1875552186189568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788666157.208216:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666157.208221:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab2a1d7c400/0x96bbe788361e9a3b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9a34 expref: 19 pid: 5800 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666157.208229:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab2a1d7c400/0x96bbe788361e9a3b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e9a34 expref: 19 pid: 5800 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666157.208239:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666157.208268:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+19:3277:x1875552186189568:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666157.208282:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788666157.208299:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788666157.208305:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+18:3277:x1875552186189696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788666157.208312:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666157.208316:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab2814ff400/0x96bbe788361e9a2d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9a26 expref: 18 pid: 5801 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666157.208324:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab2814ff400/0x96bbe788361e9a2d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e9a26 expref: 18 pid: 5801 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666157.208333:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666157.208356:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+18:3277:x1875552186189696:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666157.208362:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788666157.208529:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae841f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186189440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788666157.208567:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186189696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788666157.208573:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186189568:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788666157.210634:0:11131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2a1d7c400/0x96bbe788361e9a3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e9a34 expref: 17 pid: 5800 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666157.210669:0:11131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae279c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11131:1875552186189056:0@lo:104: 00010000:00010000:3.0:1788666157.210690:0:11131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2814ff400/0x96bbe788361e9a2d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e9a26 expref: 16 pid: 5801 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666157.210701:0:11131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae278a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11131:1875552186189184:0@lo:104: 00000100:00100000:2.0:1788666157.210714:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666157.210720:0:11131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae278700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11131:1875552186188800:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788666157.210939:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173570688 00000100:00100000:0.0:1788666157.210949:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173570688 00010000:00010000:0.0:1788666157.211001:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab2a1d7de00/0x96bbe788361e9a5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4282f expref: 13 pid: 5802 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666157.211055:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:0.0:1788666157.211064:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173570688:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788666157.211081:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666157.211088:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab2a1d7de00/0x96bbe788361e9a5e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4282f expref: 13 pid: 5802 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666157.211099:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab2a1d7de00/0x96bbe788361e9a5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4282f expref: 13 pid: 5802 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666157.211140:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2a1d7de00/0x96bbe788361e9a5e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4282f expref: 13 pid: 5802 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666157.211157:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666157.211224:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:2364:x1875552173570688:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 161us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666157.211232:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:1.0:1788666157.215112:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666157.215261:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173570816 00000100:00100000:2.0:1788666157.215275:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173570816 00010000:00010000:2.0:1788666157.215326:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e9a1f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427f7 expref: 12 pid: 5800 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666157.215618:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 29 00000100:00100000:2.0:1788666157.215631:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:2363:x1875552173570816:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788666157.215648:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666157.215654:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e9a1f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427f7 expref: 12 pid: 5800 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.215667:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e9a1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427f7 expref: 12 pid: 5800 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.215714:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a7a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.215723:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a7a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.215740:0:5794:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a7a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.215748:0:5794:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a7a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.215756:0:5794:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a7a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.215765:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a7a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.215772:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff000 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666157.215778:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a7a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.215789:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a7a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.215800:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a7a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666157.215812:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666157.215896:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:2363:x1875552173570816:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 267us (798us total) trans 0 rc 0/0 00010000:00010000:3.0:1788666157.216716:0:11131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2814ffc00/0x96bbe788361e9a1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427f7 expref: 12 pid: 5800 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666157.216748:0:11131:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa63800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11131:1875552186189312:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788666157.216797:0:11131:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a7a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666157.216806:0:11131:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a7a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666157.216812:0:11131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a7a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666157.216819:0:11131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a7a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666157.217326:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 29 00000100:00100000:0.0:1788666158.091752:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666158.091800:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666158.091827:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666158.092195:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173570944 00000100:00100000:3.0:1788666158.092210:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173570944 00000100:00100000:3.0:1788666158.092287:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 230 00000100:00100000:3.0:1788666158.092298:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+11:2361:x1875552173570944:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666158.092396:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+11:2361:x1875552173570944:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 100us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666158.092405:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 230 00000100:00100000:1.0:1788666158.093819:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173571200 00000100:00100000:1.0:1788666158.093836:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173571200 00000100:00100000:1.0:1788666158.093913:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173571072 00000100:00100000:1.0:1788666158.093917:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173571072 00000100:00100000:1.0:1788666158.093955:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 89 00000100:00100000:1.0:1788666158.093964:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84416489-fb20-4430-94f5-31470edbb54e+5:2361:x1875552173571200:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666158.094055:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84416489-fb20-4430-94f5-31470edbb54e+5:2361:x1875552173571200:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 92us (2254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666158.094086:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 89 00000100:00100000:1.0:1788666158.094103:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 90 00000100:00100000:1.0:1788666158.094110:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+6:2361:x1875552173571072:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666158.094139:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+6:2361:x1875552173571072:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 30us (2312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666158.094146:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 90 00010000:00010000:1.0:1788666158.094412:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788666158.096807:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666158.418063:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666158.418283:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173571328 00000100:00100000:1.0:1788666158.418300:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173571328 00000100:00100000:1.0:1788666158.418391:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 231 00000100:00100000:1.0:1788666158.418403:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+11:5603:x1875552173571328:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788666158.418427:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666158.418451:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2a1d7ce00/0x96bbe788361e9a81 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42859 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666158.418487:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2a1d7ce00/0x96bbe788361e9a81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42859 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666158.418501:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2a1d7ce00/0x96bbe788361e9a81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42859 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666158.418510:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2a1d7ce00, rc 0) 00000100:00100000:1.0:1788666158.418667:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:5603:x1875552173571328:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 256us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666158.418676:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 231 00000100:00100000:1.0:1788666158.426531:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666158.427288:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173571456 00000100:00100000:0.0:1788666158.427302:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173571456 00000100:00100000:0.0:1788666158.427386:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 232 00000100:00100000:0.0:1788666158.427398:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:5603:x1875552173571456:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666158.427876:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:5603:x1875552173571456:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 477us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666158.427888:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 232 00000100:00100000:0.0:1788666158.434064:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666158.434539:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173571584 00000100:00100000:3.0:1788666158.434556:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173571584 00000100:00100000:3.0:1788666158.434671:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 233 00000100:00100000:3.0:1788666158.434714:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:5603:x1875552173571584:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788666158.438261:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:5603:x1875552173571584:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 Request processed in 3546us (4174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666158.438335:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 233 00000100:00100000:2.0:1788666158.454030:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666158.457222:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173571712 00000100:00100000:1.0:1788666158.457244:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173571712 00000100:00100000:1.0:1788666158.457356:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 234 00000100:00100000:1.0:1788666158.457371:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:5603:x1875552173571712:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788666158.457391:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666158.457415:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2a1d7de00/0x96bbe788361e9a88 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42860 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666158.457456:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2a1d7de00/0x96bbe788361e9a88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42860 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666158.457470:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2a1d7de00/0x96bbe788361e9a88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42860 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666158.457481:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2a1d7de00, rc 0) 00000100:00100000:1.0:1788666158.457610:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:5603:x1875552173571712:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 209us (3560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666158.457618:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 234 00000100:00100000:1.0:1788666158.472972:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666158.477734:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173571840 00000100:00100000:3.0:1788666158.477756:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173571840 00000100:00100000:3.0:1788666158.478017:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 235 00000100:00100000:3.0:1788666158.478031:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:5603:x1875552173571840:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788666158.478514:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:5603:x1875552173571840:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 485us (5558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666158.478524:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 235 00000100:00100000:2.0:1788666158.489724:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666158.489789:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173571968 00000100:00100000:0.0:1788666158.489859:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173571968 00000100:00100000:0.0:1788666158.489922:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 236 00000100:00100000:0.0:1788666158.489931:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:5603:x1875552173571968:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788666158.490249:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:5603:x1875552173571968:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 Request processed in 317us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666158.490268:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 236 10000000:01000000:1.0:1788666158.610324:0:5804:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1788666158.610340:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff8ab2bbf65000 from 7 10000000:01000000:1.0:1788666158.610347:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788666158.610422:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666158.610437:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666158.610450:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a8f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666158.610510:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186189824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788666158.610639:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666158.610715:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bfb24f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788666158.611086:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186189824 00000100:00100000:3.0:1788666158.611097:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186189824 00000100:00100000:3.0:1788666158.611181:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788666158.611195:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+16:5804:x1875552186189824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666158.611217:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666158.611237:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a96 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e9a8f expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666158.611274:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e9a8f expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666158.611287:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9a8f expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666158.611299:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814ff000, rc 0) 00000100:00100000:3.0:1788666158.611423:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186189824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 232us (784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666158.611431:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788666158.616258:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186189824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788666158.616531:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666158.616546:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a8f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666158.616675:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186189952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788666158.616762:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666158.616803:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bfb24f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788666158.617525:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186189952 00000100:00100000:0.0:1788666158.617538:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186189952 00000100:00100000:0.0:1788666158.617653:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788666158.617665:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186189952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666158.618006:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186189952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 333us (1234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666158.618018:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788666158.618345:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186189952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788666158.618399:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186190080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788666158.618448:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666158.618481:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bfb24f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788666158.618746:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186190080 00000100:00100000:0.0:1788666158.618753:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186190080 00000100:00100000:0.0:1788666158.618794:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788666158.618803:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186190080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788666158.619012:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186190080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 209us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666158.619019:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788666158.619098:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186190080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788666158.621150:0:11146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788666158.624509:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788666158.624556:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788666158.624572:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a8f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666158.624624:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666158.624638:0:5804:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:3.0:1788666158.624642:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff8ab2bcd59800 from 7 10000000:01000000:3.0:1788666158.624645:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788666158.625030:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9a9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666158.625043:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9a9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666158.625058:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9a9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666158.625093:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186190208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788666158.625186:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666158.625251:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bbe86840 going to sleep for 11 seconds 00000100:00100000:1.0:1788666158.625433:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186190208 00000100:00100000:1.0:1788666158.625444:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186190208 00000100:00100000:1.0:1788666158.625500:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788666158.625512:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186190208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788666158.625532:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666158.625547:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2a1d7c000/0x96bbe788361e9aa4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e9a9d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666158.625627:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2a1d7c000/0x96bbe788361e9aa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e9a9d expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666158.625638:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2a1d7c000/0x96bbe788361e9aa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9a9d expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666158.625647:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2a1d7c000, rc 0) 00000100:00100000:1.0:1788666158.625692:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186190208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 183us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666158.625699:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788666158.625815:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186190208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666158.625832:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9a9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666158.625841:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9a9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666158.625920:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186190336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788666158.625955:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666158.625992:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bbe86840 going to sleep for 11 seconds 00000100:00100000:0.0:1788666158.628294:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186190336 00000100:00100000:0.0:1788666158.628323:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186190336 00000100:00100000:0.0:1788666158.628427:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788666158.628440:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186190336:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666158.628957:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186190336:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 517us (2998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666158.628968:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788666158.629072:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa63800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186190336:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666158.629157:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186190464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788666158.629227:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666158.629265:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab183862d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788666158.629281:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186190464 00000100:00100000:0.0:1788666158.629286:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186190464 00000100:00100000:0.0:1788666158.629310:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788666158.629317:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186190464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788666158.629488:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186190464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 171us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666158.629495:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788666158.629527:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186190464:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788666158.630303:0:11148:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788666158.630378:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788666158.630402:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788666158.630411:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9a9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666158.630425:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9a9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666158.630436:0:5804:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:0.0:1788666158.630439:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff8ab290a54800 from 7 10000000:01000000:0.0:1788666158.630442:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788666158.630476:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9aab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666158.630485:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9aab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666158.630495:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9aab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666158.630523:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186190592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788666158.630604:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666158.630626:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab1838629c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788666158.630642:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186190592 00000100:00100000:0.0:1788666158.630647:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186190592 00000100:00100000:0.0:1788666158.630674:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788666158.630681:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186190592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788666158.630695:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666158.630710:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab28144b800/0x96bbe788361e9ab2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e9aab expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666158.630740:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab28144b800/0x96bbe788361e9ab2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e9aab expref: 19 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666158.630751:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab28144b800/0x96bbe788361e9ab2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9aab expref: 19 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666158.630760:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144b800, rc 0) 00000100:00100000:0.0:1788666158.630792:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:5804:x1875552186190592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666158.630799:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788666158.630838:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186190592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788666158.630854:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9aab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666158.630864:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9aab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666158.630917:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186190720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666158.630941:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666158.630952:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab1838629c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788666158.630961:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186190720 00000100:00100000:0.0:1788666158.630964:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186190720 00000100:00100000:0.0:1788666158.630978:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788666158.630983:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:5804:x1875552186190720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666158.631309:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:5804:x1875552186190720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666158.631316:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788666158.631341:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186190720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666158.631364:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186190848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788666158.631402:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666158.631414:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab1838629c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788666158.631424:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186190848 00000100:00100000:0.0:1788666158.631427:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186190848 00000100:00100000:0.0:1788666158.631443:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788666158.631448:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:5804:x1875552186190848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788666158.631622:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:5804:x1875552186190848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666158.631629:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788666158.631663:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186190848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788666158.648177:0:11149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788666158.660754:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788666158.660803:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788666158.660818:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9aab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666158.661046:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9aab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666159.130986:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666159.498871:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186190976:0@lo:400:kworker.0 00000100:00100000:1.0:1788666159.498971:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666159.499040:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186191488:0@lo:400:kworker.0 00000100:00100000:1.0:1788666159.499084:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666159.499110:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788666159.499117:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186191104:0@lo:400:kworker.0 00000100:00100000:1.0:1788666159.499154:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666159.499173:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab29057a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186191616:0@lo:400:kworker.0 00000100:00100000:1.0:1788666159.499211:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666159.499241:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186191232:0@lo:400:kworker.0 00000100:00100000:1.0:1788666159.499268:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666159.499288:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788666159.499294:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186191360:0@lo:400:kworker.0 00000100:00100000:1.0:1788666159.499316:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666159.499365:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186190976 00000100:00100000:1.0:1788666159.499375:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186190976 00000100:00100000:1.0:1788666159.499431:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788666159.499442:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186190976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666159.499495:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186190976:12345-0@lo:400:kworker.0 Request processed in 56us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666159.499503:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788666159.499537:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186191488 00000100:00100000:1.0:1788666159.499541:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186191488 00000100:00100000:1.0:1788666159.499603:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186191104 00000100:00100000:1.0:1788666159.499607:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186191104 00000100:00100000:1.0:1788666159.499621:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186191232 00000100:00100000:1.0:1788666159.499624:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186191232 00000100:00100000:1.0:1788666159.499638:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788666159.499644:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186191488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666159.499678:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290579500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186191488:12345-0@lo:400:kworker.0 Request processed in 34us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666159.499684:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788666159.499696:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788666159.499701:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29057a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186191104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666159.499728:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29057a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186191104:12345-0@lo:400:kworker.0 Request processed in 27us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666159.499739:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788666159.499750:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788666159.499755:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29057ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186191232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666159.499789:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29057ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186191232:12345-0@lo:400:kworker.0 Request processed in 34us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666159.499795:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788666159.499820:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186191616 00000100:00100000:1.0:1788666159.499823:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186191616 00000100:00100000:1.0:1788666159.499848:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186191360 00000100:00100000:1.0:1788666159.499851:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186191360 00000100:00100000:1.0:1788666159.499870:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788666159.499875:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186191616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666159.499905:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290579180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186191616:12345-0@lo:400:kworker.0 Request processed in 30us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666159.499911:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788666159.499923:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788666159.499928:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29057b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186191360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666159.499955:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29057b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186191360:12345-0@lo:400:kworker.0 Request processed in 28us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666159.499960:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788666159.499999:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788666159.500004:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788666159.500007:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788666159.500051:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2aea3ed80 x1875552186191360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666159.500067:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186191360:0@lo:400:kworker.0 00000100:00100000:1.0:1788666159.500087:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186191232:0@lo:400:kworker.0 00000100:00100000:1.0:1788666159.500122:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186191104:0@lo:400:kworker.0 00010000:00080000:1.0:1788666159.500134:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab29057a680 x1875552186191616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666159.500142:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab29057a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186191616:0@lo:400:kworker.0 00000100:00100000:1.0:1788666159.500151:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186190976:0@lo:400:kworker.0 00000100:00100000:1.0:1788666159.500160:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186191488:0@lo:400:kworker.0 00000100:00100000:3.0:1788666160.011004:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788666160.011045:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186191744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788666160.011153:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666160.011248:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186191744 00000100:00100000:3.0:1788666160.011260:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186191744 00000100:00100000:3.0:1788666160.011441:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788666160.011454:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186191744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788666160.011506:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666160.011566:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186191744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666160.011573:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1788666160.011654:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bfa63100 x1875552186191744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666160.011680:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186191744:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788666160.149368:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666161.036685:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab29057a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186191872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788666161.036777:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666161.036892:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186191872 00000100:00100000:1.0:1788666161.036904:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186191872 00000100:00100000:1.0:1788666161.036972:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788666161.036983:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29057b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186191872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788666161.037022:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666161.037068:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29057b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186191872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666161.037076:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1788666161.037099:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788666161.037129:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab29057a680 x1875552186191872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666161.037148:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab29057a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186191872:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788666161.162783:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666162.187742:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788666162.670808:0:11331:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788666163.213522:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666163.218163:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666163.218209:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666163.218252:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666163.218287:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173572352 00000100:00100000:3.0:1788666163.218299:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173572352 00000100:00100000:1.0:1788666163.218344:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173572096 00000100:00100000:1.0:1788666163.218350:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173572096 00000100:00100000:3.0:1788666163.218375:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173572224 00000100:00100000:3.0:1788666163.218392:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173572224 00000100:00100000:1.0:1788666163.218416:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 247 00000100:00100000:1.0:1788666163.218428:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173572096:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666163.218431:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 94 00000100:00100000:3.0:1788666163.218452:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173572352:12345-192.168.201.25@tcp:400:kworker.0 00000100:00080000:2.0:1788666163.218526:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666163.218572:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 95 00000100:00100000:2.0:1788666163.218617:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173572224:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666163.218816:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290465c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173572096:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 390us (666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666163.218824:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 247 00000100:00100000:3.0:1788666163.221412:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae843100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173572352:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 1925us (2163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666163.221433:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 94 00000100:00100000:2.0:1788666163.227271:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173572224:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 8671us (8998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666163.227291:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 95 00010000:00010000:3.0:1788666164.236666:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666164.618913:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788666164.620693:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b422a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186192128:0@lo:400:kworker.0 00000100:00100000:0.0:1788666164.620908:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666164.621086:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b422b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186192000:0@lo:400:kworker.0 00000100:00100000:0.0:1788666164.621125:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666164.623090:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186192640:0@lo:400:kworker.0 00000100:00100000:2.0:1788666164.623193:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666164.623254:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788666164.623261:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186192512:0@lo:400:kworker.0 00000100:00100000:2.0:1788666164.623295:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666164.624509:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186192000 00000100:00100000:3.0:1788666164.624525:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186192000 00000100:00100000:3.0:1788666164.624632:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788666164.624644:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186192000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666164.624725:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290466450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186192000:12345-0@lo:400:kworker.0 Request processed in 84us (3598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666164.624732:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788666164.626327:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186192256:0@lo:400:kworker.0 00000100:00100000:3.0:1788666164.628700:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186192384:0@lo:400:kworker.0 00000100:00100000:3.0:1788666164.628779:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666164.630107:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186192640 00000100:00100000:2.0:1788666164.630126:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186192640 00000100:00100000:2.0:1788666164.630237:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186192384 00000100:00100000:2.0:1788666164.630241:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186192384 00000100:00100000:2.0:1788666164.630280:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788666164.630291:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186192640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666164.630775:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186192640:12345-0@lo:400:kworker.0 Request processed in 484us (7580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666164.630796:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788666164.630818:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788666164.630826:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186192384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666164.630861:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186192384:12345-0@lo:400:kworker.0 Request processed in 37us (2082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666164.630867:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788666164.630904:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666164.633185:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186192128 00000100:00100000:1.0:1788666164.633203:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186192128 00000100:00100000:1.0:1788666164.633299:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186192512 00000100:00100000:1.0:1788666164.633312:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186192512 00000100:00100000:1.0:1788666164.633358:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788666164.633368:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186192128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666164.633465:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186192128:12345-0@lo:400:kworker.0 Request processed in 99us (12558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666164.633473:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788666164.633493:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788666164.633500:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186192512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666164.633530:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186192512:12345-0@lo:400:kworker.0 Request processed in 32us (10235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666164.633535:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1788666164.634688:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788666164.634701:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788666164.634705:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788666164.639769:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2989fd880 x1875552186192384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666164.639809:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186192384:0@lo:400:kworker.0 00000100:00100000:2.0:1788666164.641973:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186192512:0@lo:400:kworker.0 00010000:00080000:2.0:1788666164.642005:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2989fce00 x1875552186192640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666180 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666164.642018:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186192640:0@lo:400:kworker.0 00000100:00100000:2.0:1788666164.642034:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b422a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186192128:0@lo:400:kworker.0 00000100:00100000:2.0:1788666164.642045:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b422b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186192000:0@lo:400:kworker.0 00000100:00100000:3.0:1788666164.642463:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186192256 00000100:00100000:3.0:1788666164.642477:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186192256 00000100:00080000:2.0:1788666164.642633:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788666164.643533:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788666164.643603:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186192256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666164.643782:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186192256:12345-0@lo:400:kworker.0 Request processed in 212us (12888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666164.643804:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788666164.644109:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186192256:0@lo:400:kworker.0 00000100:00100000:3.0:1788666165.132600:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186192768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788666165.132681:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666165.132760:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186192768 00000100:00100000:3.0:1788666165.132768:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186192768 00000100:00100000:3.0:1788666165.132840:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788666165.132849:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186192768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788666165.132900:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666165.132953:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186192768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666165.132976:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1788666165.133039:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bfa60700 x1875552186192768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666165.133059:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186192768:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788666165.259085:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666166.154920:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666166.154950:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab29057a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186192896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788666166.155056:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666166.155228:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186192896 00000100:00100000:3.0:1788666166.155239:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186192896 00000100:00100000:3.0:1788666166.155321:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788666166.155338:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186192896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788666166.155403:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666166.155469:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186192896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666166.155477:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1788666166.155805:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788666166.155927:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab29057a680 x1875552186192896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666166.155951:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab29057a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186192896:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788666166.283027:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788666167.142817:0:11430:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 23:42:45 (1788666165) === 00010000:00010000:0.0:1788666167.309316:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666167.400422:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666167.400525:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666167.400973:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173572608 00000100:00100000:3.0:1788666167.400989:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173572608 00000100:00100000:3.0:1788666167.401081:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:3.0:1788666167.401100:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0911d461-5865-4ef7-8c3e-012fc04add58+6:9705:x1875552173572608:12345-192.168.201.25@tcp:700:mkdir.0 00000100:00100000:3.0:1788666167.401314:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0911d461-5865-4ef7-8c3e-012fc04add58+6:9705:x1875552173572608:12345-192.168.201.25@tcp:700:mkdir.0 Request processed in 220us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666167.401324:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:1.0:1788666167.401893:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173572480 00000100:00100000:1.0:1788666167.401902:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173572480 00000100:00100000:1.0:1788666167.402091:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:1.0:1788666167.402101:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:2362:x1875552173572480:12345-192.168.201.25@tcp:41:mkdir.0 00000004:00000024:1.0:1788666167.402143:0:5808:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788666167.402303:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:2362:x1875552173572480:12345-192.168.201.25@tcp:41:mkdir.0 Request processed in 203us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666167.402312:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00080000:2.0:1788666167.403039:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666167.405529:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666167.405933:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173572864 00000100:00100000:0.0:1788666167.405951:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173572864 00000100:00100000:0.0:1788666167.406038:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:0.0:1788666167.406050:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:9705:x1875552173572864:12345-192.168.201.25@tcp:36:mkdir.0 00010000:00010000:0.0:1788666167.406125:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666167.406159:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e999a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427e2 expref: 6 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.406181:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:0.0:1788666167.406273:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788666167.406823:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9ab9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.406842:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9ab9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.406863:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9ab9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.406949:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9ac0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.406957:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.406964:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666167.409429:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788666167.409451:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9ab9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.409461:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9ab9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.409468:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9ab9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.409475:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144a600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666167.409480:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9ab9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.409488:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9ab9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.409510:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab290a48500) 00010000:00010000:0.0:1788666167.409513:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666167.409519:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9ab9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.409539:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9ab9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788666167.409568:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003a388059 reply state 00000000f141d711 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666167.409725:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788666167.409966:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+7:9705:x1875552173572864:12345-192.168.201.25@tcp:36:mkdir.0 Request processed in 3909us (4445us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788666167.409978:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00010000:00010000:2.0:1788666167.414533:0:3261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9ac0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.414560:0:3261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9ac0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.414568:0:3261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9ac0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.414575:0:3261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144a800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666167.414682:0:3261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9ac0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.414694:0:3261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9ac0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.414728:0:3261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ab290a48b00) 00010000:00010000:2.0:1788666167.414732:0:3261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666167.414802:0:3261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9ac0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.414812:0:3261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9ac0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666167.429779:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666167.429934:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173572992 00000100:00100000:1.0:1788666167.429946:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173572992 00000100:00100000:1.0:1788666167.430015:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:1.0:1788666167.430026:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:9706:x1875552173572992:12345-192.168.201.25@tcp:101:chmod.0 00010000:00010000:1.0:1788666167.430048:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666167.430074:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7ca00/0x96bbe788361e9ac7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42867 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.430145:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9ace lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.430159:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9ace lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.430171:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9ace lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666167.430246:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788666167.430250:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788666167.430287:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9ace lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.430313:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7ca00/0x96bbe788361e9ac7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42867 expref: 8 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.430332:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9ace lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42867 expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.430341:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2908f2400) 00010000:00010000:1.0:1788666167.430345:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788666167.430348:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2a1d7c400, rc 0) 00000100:00100000:1.0:1788666167.430402:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+7:9706:x1875552173572992:12345-192.168.201.25@tcp:101:chmod.0 Request processed in 379us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666167.430409:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:0.0:1788666167.435534:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666167.435678:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173573248 00000100:00100000:1.0:1788666167.435692:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173573248 00000100:00100000:1.0:1788666167.435753:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:1.0:1788666167.435764:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+7:9706:x1875552173573248:12345-192.168.201.25@tcp:36:chmod.0 00010000:00010000:1.0:1788666167.435831:0:7132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666167.435876:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9ace lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42867 expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.435903:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2908f2400) 00010000:00010000:1.0:1788666167.436255:0:7132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788666167.436290:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7ca00/0x96bbe788361e9ad5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.436308:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7ca00/0x96bbe788361e9ad5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.436321:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7ca00/0x96bbe788361e9ad5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788666167.437201:0:7132:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ba7ed116 reply state 00000000961b14d4 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7ca00/0x96bbe788361e9ad5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666167.437218:0:7132:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788666167.437231:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788666167.437432:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+8:9706:x1875552173573248:12345-192.168.201.25@tcp:36:chmod.0 Request processed in 1663us (1906us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788666167.437442:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00010000:00010000:2.0:1788666167.451433:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7ca00/0x96bbe788361e9ad5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.451474:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7ca00/0x96bbe788361e9ad5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.451485:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7ca00/0x96bbe788361e9ad5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.451494:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7ca00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666167.451500:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7ca00/0x96bbe788361e9ad5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.451509:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7ca00/0x96bbe788361e9ad5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.451538:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:2.0:1788666167.451542:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788666167.451547:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7ca00/0x96bbe788361e9ad5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.451554:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7ca00/0x96bbe788361e9ad5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666167.479920:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666167.480107:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173573376 00000100:00100000:1.0:1788666167.480124:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173573376 00000100:00100000:1.0:1788666167.480228:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:1.0:1788666167.480239:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+7:9707:x1875552173573376:12345-192.168.201.25@tcp:101:chown.0 00010000:00010000:1.0:1788666167.480276:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666167.480308:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9adc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d4286e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.480441:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7ca00/0x96bbe788361e9ae3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.480461:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7ca00/0x96bbe788361e9ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.480499:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7ca00/0x96bbe788361e9ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666167.480556:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788666167.480560:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788666167.480667:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7ca00/0x96bbe788361e9ae3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.480704:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9adc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4286e expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.480729:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7ca00/0x96bbe788361e9ae3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4286e expref: 8 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.480810:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2908f2400) 00010000:00010000:1.0:1788666167.480814:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788666167.480820:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2a1d7ca00, rc 0) 00000100:00100000:1.0:1788666167.480923:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+8:9707:x1875552173573376:12345-192.168.201.25@tcp:101:chown.0 Request processed in 684us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666167.480931:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:0.0:1788666167.489457:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666167.489650:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173573504 00000100:00100000:3.0:1788666167.489746:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173573504 00000100:00100000:3.0:1788666167.489840:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:3.0:1788666167.489865:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+8:9707:x1875552173573504:12345-192.168.201.25@tcp:101:chown.0 00010000:00010000:3.0:1788666167.490079:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666167.490125:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9aea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42875 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.490214:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe800/0x96bbe788361e9af1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.490232:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe800/0x96bbe788361e9af1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.490247:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe800/0x96bbe788361e9af1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.490266:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9af8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.490272:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9af8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.490278:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9af8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.490391:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9aff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.490399:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9aff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.490405:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9aff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666167.490435:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788666167.490444:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788666167.490465:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9aff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.490485:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe800/0x96bbe788361e9af1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.490492:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe800/0x96bbe788361e9af1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.490499:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe800/0x96bbe788361e9af1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.490505:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814fe800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666167.490510:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe800/0x96bbe788361e9af1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.490519:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe800/0x96bbe788361e9af1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.490532:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2908f2400) 00010000:00010000:3.0:1788666167.490535:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666167.490541:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe800/0x96bbe788361e9af1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.490548:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe800/0x96bbe788361e9af1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.490565:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9af8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.490572:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9af8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.490645:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9af8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.492087:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814fe600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666167.492095:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9af8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.492105:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9af8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.492122:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ab2b9e72500) 00010000:00010000:3.0:1788666167.492124:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666167.492128:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9af8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.492134:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9af8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.492431:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9aea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42875 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.492448:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9aff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42875 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.492454:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab2b9e72b00) 00010000:00010000:3.0:1788666167.492455:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788666167.492457:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814ff200, rc 0) 00000100:00100000:3.0:1788666167.492554:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+9:9707:x1875552173573504:12345-192.168.201.25@tcp:101:chown.0 Request processed in 2696us (3116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666167.492562:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:0.0:1788666167.498059:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666167.498501:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173573760 00000100:00100000:1.0:1788666167.498519:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173573760 00000100:00100000:1.0:1788666167.498779:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:1.0:1788666167.498795:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+9:9707:x1875552173573760:12345-192.168.201.25@tcp:36:chown.0 00010000:00010000:1.0:1788666167.498882:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666167.498930:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9aff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42875 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.498982:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab2b9e72b00) 00010000:00010000:1.0:1788666167.498995:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788666167.499026:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9b06 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.499041:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9b06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.499051:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9b06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788666167.558873:0:5808:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c4c6c9d1 reply state 000000009b61b295 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9b06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666167.558972:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788666167.558988:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788666167.559153:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+10:9707:x1875552173573760:12345-192.168.201.25@tcp:36:chown.0 Request processed in 60357us (61108us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788666167.559164:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00000001:00080000:3.0:1788666167.559285:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:3.0:1788666167.559317:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:2.0:1788666167.559376:0:3261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9b06 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.559393:0:3261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9b06 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.559402:0:3261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9b06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.559410:0:3261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7c400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666167.559416:0:3261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9b06 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.559426:0:3261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9b06 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.559449:0:3261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:2.0:1788666167.559452:0:3261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788666167.559458:0:3261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9b06 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.559465:0:3261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9b06 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666167.582757:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666167.582995:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173573888 00000100:00100000:2.0:1788666167.583011:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173573888 00000100:00100000:2.0:1788666167.583093:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:2.0:1788666167.583106:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+6:9708:x1875552173573888:12345-192.168.201.25@tcp:101:touch.500 00010000:00010000:2.0:1788666167.583133:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666167.583158:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5e00/0x96bbe788361e9b0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d4287c expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788666167.585104:0:7132:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1867us 00010000:00010000:2.0:1788666167.600751:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5600/0x96bbe788361e9b14 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.600781:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5600/0x96bbe788361e9b14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.600797:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5600/0x96bbe788361e9b14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.600814:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4a00/0x96bbe788361e9b1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.600822:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4a00/0x96bbe788361e9b1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.600828:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4a00/0x96bbe788361e9b1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.601202:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361e9b22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.601211:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361e9b22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.601218:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361e9b22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666167.601240:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788666167.601245:0:7132:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788666167.601282:0:7132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361e9b22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.601295:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5600/0x96bbe788361e9b14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.601308:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5600/0x96bbe788361e9b14 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.601315:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5600/0x96bbe788361e9b14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.601321:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd5600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666167.601325:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5600/0x96bbe788361e9b14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.601333:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5600/0x96bbe788361e9b14 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.601345:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2908f2400) 00010000:00010000:2.0:1788666167.601348:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666167.601353:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5600/0x96bbe788361e9b14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.601360:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5600/0x96bbe788361e9b14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.601370:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4a00/0x96bbe788361e9b1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.601389:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4a00/0x96bbe788361e9b1b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.601395:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4a00/0x96bbe788361e9b1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.601400:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4a00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666167.601408:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4a00/0x96bbe788361e9b1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.601415:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4a00/0x96bbe788361e9b1b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.601423:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ab2a088ee00) 00010000:00010000:2.0:1788666167.601426:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666167.601428:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4a00/0x96bbe788361e9b1b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.601434:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4a00/0x96bbe788361e9b1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.601476:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5e00/0x96bbe788361e9b0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4287c expref: 8 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.601489:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361e9b22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4287c expref: 7 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.601496:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab2a088e800) 00010000:00010000:2.0:1788666167.601499:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788666167.601501:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd5200, rc 0) 00000100:00100000:2.0:1788666167.601719:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+7:9708:x1875552173573888:12345-192.168.201.25@tcp:101:touch.500 Request processed in 18612us (18984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666167.601729:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:0.0:1788666167.607123:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666167.607301:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173574144 00000100:00100000:2.0:1788666167.607319:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173574144 00000100:00100000:2.0:1788666167.607452:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:2.0:1788666167.607467:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+7:9708:x1875552173574144:12345-192.168.201.25@tcp:101:touch.500 00010000:00010000:2.0:1788666167.607530:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666167.607566:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361e9b29 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42883 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.608004:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9b30 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.608025:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9b30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.608040:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9b30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.608130:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9b37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.608141:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9b37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.608149:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9b37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788666167.609020:0:5809:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788666167.609368:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361e9b3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.609382:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361e9b3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.609394:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361e9b3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.609465:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9b30 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.609474:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9b30 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.609483:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9b30 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.609492:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7c400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666167.609499:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9b30 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.609509:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9b30 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.609524:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab2a088e800) 00010000:00010000:2.0:1788666167.609527:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666167.609534:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9b30 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.609541:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7c400/0x96bbe788361e9b30 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788666167.609558:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026824534 reply state 000000007359974c transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9b37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666167.609569:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788666167.609647:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361e9b29 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42883 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.609674:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361e9b3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42883 expref: 9 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.609683:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ab2a088ec00) 00010000:00010000:2.0:1788666167.609685:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666167.609687:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f3e00, rc 0) 00000100:00100000:2.0:1788666167.609782:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae727b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+10:9708:x1875552173574144:12345-192.168.201.25@tcp:101:touch.500 Request processed in 2317us (2678us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788666167.609792:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:0.0:1788666167.616010:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666167.616223:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173574400 00000100:00100000:1.0:1788666167.616241:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173574400 00000100:00100000:1.0:1788666167.616330:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:1.0:1788666167.616345:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+10:9708:x1875552173574400:12345-192.168.201.25@tcp:36:touch.500 00010000:00010000:1.0:1788666167.616434:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666167.616468:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361e9b3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42883 expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.616489:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ab2a088ec00) 00010000:00010000:1.0:1788666167.616499:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788666167.616558:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854800/0x96bbe788361e9b4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.616614:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854800/0x96bbe788361e9b4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.616627:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854800/0x96bbe788361e9b4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788666167.616832:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8239406 reply state 00000000e0bb0e01 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854800/0x96bbe788361e9b4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666167.616858:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788666167.616996:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+11:9708:x1875552173574400:12345-192.168.201.25@tcp:36:touch.500 Request processed in 654us (997us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788666167.617006:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 23 00010000:00010000:2.0:1788666167.617154:0:3261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9b37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.617164:0:3261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9b37 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.617172:0:3261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9b37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.617178:0:3261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2c00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666167.617184:0:3261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9b37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.617204:0:3261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9b37 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.617217:0:3261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9f0a7a27 (ffff8ab2a088e200) 00010000:00010000:2.0:1788666167.617220:0:3261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666167.617224:0:3261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9b37 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.617240:0:3261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9b37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.621565:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854800/0x96bbe788361e9b4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.621615:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854800/0x96bbe788361e9b4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.621625:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854800/0x96bbe788361e9b4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.621632:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298854800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666167.621639:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854800/0x96bbe788361e9b4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.621648:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854800/0x96bbe788361e9b4c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.621669:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ab2908f2f00) 00010000:00010000:3.0:1788666167.621672:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666167.621679:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854800/0x96bbe788361e9b4c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.621687:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854800/0x96bbe788361e9b4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666167.624097:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666167.624218:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173574528 00000100:00100000:1.0:1788666167.624233:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173574528 00000100:00100000:1.0:1788666167.624315:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:1.0:1788666167.624327:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+9:9708:x1875552173574528:12345-192.168.201.25@tcp:101:touch.500 00010000:00010000:1.0:1788666167.624363:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666167.624408:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361e9b53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d4288a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.624495:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361e9b53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4288a expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.624512:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361e9b53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4288a expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.624533:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ab2908f2900) 00010000:00010000:1.0:1788666167.624537:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788666167.624542:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298854600, rc 0) 00000100:00100000:1.0:1788666167.624651:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+10:9708:x1875552173574528:12345-192.168.201.25@tcp:101:touch.500 Request processed in 327us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666167.624659:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:0.0:1788666167.634838:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666167.635040:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173574656 00000100:00100000:1.0:1788666167.635052:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173574656 00000100:00100000:1.0:1788666167.635130:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:1.0:1788666167.635140:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1875552173574656:12345-192.168.201.25@tcp:8:touch.500 00010000:00080000:1.0:1788666167.635180:0:6651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp t0 exp 0000000000000000 cur 274 last 0 00000020:00000080:1.0:1788666167.635224:0:6651:0:(genops.c:1385:class_connect()) connect: client 0911d461-5865-4ef7-8c3e-012fc04add58, cookie 0x96bbe788361e9b5a 00002000:00100000:1.0:1788666167.635237:0:6651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0911d461-5865-4ef7-8c3e-012fc04add58/ffff8ab28638a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788666167.635264:0:6651:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788666167.635547:0:6651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788666167.635666:0:6651:0:(import.c:65:import_set_state_nolock()) ffff8ab2c1f2b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788666167.635731:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2357:x1875552173574656:12345-192.168.201.25@tcp:8:touch.500 Request processed in 591us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666167.636013:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:0.0:1788666167.638221:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666167.638415:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173574784 00000100:00100000:1.0:1788666167.638427:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173574784 00000100:00100000:1.0:1788666167.638521:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:1.0:1788666167.638533:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+6:0:x1875552173574784:12345-192.168.201.25@tcp:2:touch.500 00000100:00080000:2.0:1788666167.641881:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788666167.670483:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+7:0:x1875552173574784:12345-192.168.201.25@tcp:2:touch.500 Request processed in 31935us (32258us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788666167.670502:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 18 00000001:00080000:0.0:1788666167.670884:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:0.0:1788666167.670897:0:6678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0911d461-5865-4ef7-8c3e-012fc04add58 00000100:00100000:0.0:1788666167.673155:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666167.673255:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173575040 00000100:00100000:1.0:1788666167.673266:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173575040 00000100:00100000:1.0:1788666167.673330:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:1.0:1788666167.673341:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+10:9708:x1875552173575040:12345-192.168.201.25@tcp:35:touch.500 00000100:00100000:1.0:1788666167.673732:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+11:9708:x1875552173575040:12345-192.168.201.25@tcp:35:touch.500 Request processed in 391us (585us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788666167.674076:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:2.0:1788666167.689155:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666167.689754:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173575168 00000100:00100000:1.0:1788666167.689768:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173575168 00000100:00100000:1.0:1788666167.689854:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:1.0:1788666167.689868:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+11:9709:x1875552173575168:12345-192.168.201.25@tcp:101:rm.0 00010000:00010000:1.0:1788666167.689909:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666167.689940:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9b61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42891 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.690045:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361e9b68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.690065:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361e9b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.690082:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361e9b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666167.690127:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788666167.690131:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788666167.690173:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361e9b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.690221:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9b61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42891 expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.690242:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361e9b68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42891 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.690275:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab2a088e800) 00010000:00010000:1.0:1788666167.690280:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788666167.690284:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855400, rc 0) 00000100:00100000:1.0:1788666167.690907:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+12:9709:x1875552173575168:12345-192.168.201.25@tcp:101:rm.0 Request processed in 1038us (1758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666167.690917:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:0.0:1788666167.698720:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666167.698935:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173575424 00000100:00100000:1.0:1788666167.698949:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173575424 00000100:00100000:1.0:1788666167.699022:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00100000:1.0:1788666167.699030:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+12:9709:x1875552173575424:12345-192.168.201.25@tcp:101:rm.0 00010000:00010000:1.0:1788666167.699054:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666167.699073:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9b6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42898 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666167.699167:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788666167.699313:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9b6f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42898 expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.699324:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2908f2400) 00010000:00010000:1.0:1788666167.699327:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788666167.699330:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9b6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42898 expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.699341:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855800, rc 0) 00000100:00100000:1.0:1788666167.699603:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+13:9709:x1875552173575424:12345-192.168.201.25@tcp:101:rm.0 Request processed in 574us (894us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1788666167.699617:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00100000:3.0:1788666167.702820:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666167.703258:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173575552 00000100:00100000:1.0:1788666167.703273:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173575552 00000100:00100000:1.0:1788666167.703343:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:1.0:1788666167.703353:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+13:9709:x1875552173575552:12345-192.168.201.25@tcp:37:rm.0 00000100:00100000:1.0:1788666167.708396:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+13:9709:x1875552173575552:12345-192.168.201.25@tcp:37:rm.0 Request processed in 5020us (5568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666167.708418:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:3.0:1788666167.712683:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666167.712983:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173575808 00000100:00100000:2.0:1788666167.712996:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173575808 00000100:00100000:2.0:1788666167.713059:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:2.0:1788666167.713067:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28f367850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+13:9709:x1875552173575808:12345-192.168.201.25@tcp:35:rm.0 00000100:00100000:2.0:1788666167.713446:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28f367850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+14:9709:x1875552173575808:12345-192.168.201.25@tcp:35:rm.0 Request processed in 377us (775us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788666167.713452:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:3.0:1788666167.716344:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666167.716498:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173576064 00000100:00100000:0.0:1788666167.716511:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173576064 00000100:00100000:0.0:1788666167.716615:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:0.0:1788666167.716625:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+14:9709:x1875552173576064:12345-192.168.201.25@tcp:101:rm.0 00010000:00010000:0.0:1788666167.716669:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666167.716693:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9b7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d4289f expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.716811:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9b84 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.716826:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9b84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.716846:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9b84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666167.716858:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788666167.717043:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9b7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4289f expref: 17 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.717064:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9b84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4289f expref: 16 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.717074:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab2a088e800) 00010000:00010000:0.0:1788666167.717078:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788666167.717083:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144a600, rc 0) 00000100:00100000:0.0:1788666167.717156:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+16:9709:x1875552173576064:12345-192.168.201.25@tcp:101:rm.0 Request processed in 532us (825us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788666167.717165:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:0.0:1788666167.726170:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666167.726301:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173576192 00000100:00100000:2.0:1788666167.726314:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173576192 00000100:00100000:2.0:1788666167.726433:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:2.0:1788666167.726444:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+16:9709:x1875552173576192:12345-192.168.201.25@tcp:41:rm.0 00000004:00000024:2.0:1788666167.726525:0:5809:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788666167.726643:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+16:9709:x1875552173576192:12345-192.168.201.25@tcp:41:rm.0 Request processed in 201us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666167.726652:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:1.0:1788666167.729344:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666167.729688:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173576320 00000100:00100000:0.0:1788666167.729705:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173576320 00000100:00100000:0.0:1788666167.729864:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 29 00000100:00100000:0.0:1788666167.729879:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+16:9709:x1875552173576320:12345-192.168.201.25@tcp:101:rm.0 00010000:00010000:0.0:1788666167.729921:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666167.730012:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9b92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d428a6 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730105:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361e9b99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730122:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361e9b99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730137:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361e9b99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730158:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9ba0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730165:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730171:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730365:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a000/0x96bbe788361e9ba7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730374:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a000/0x96bbe788361e9ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730381:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a000/0x96bbe788361e9ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666167.730428:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788666167.730433:0:7132:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788666167.730458:0:7132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a000/0x96bbe788361e9ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730472:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a000/0x96bbe788361e9ba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730482:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361e9b99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730489:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361e9b99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730496:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361e9b99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730502:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144ae00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666167.730508:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361e9b99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730516:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361e9b99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730532:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab2a088e800) 00010000:00010000:0.0:1788666167.730535:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666167.730541:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361e9b99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730547:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361e9b99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730725:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9ba0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730733:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9ba0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730740:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730746:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144b400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666167.730750:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9ba0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730757:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9ba0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730766:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9f0a7a27 (ffff8ab290a48b00) 00010000:00010000:0.0:1788666167.730768:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666167.730771:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9ba0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730777:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9ba0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730820:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9b92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428a6 expref: 18 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730836:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a000/0x96bbe788361e9ba7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428a6 expref: 17 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666167.730863:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ab2908f2900) 00010000:00010000:0.0:1788666167.730865:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788666167.730869:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144a000, rc 0) 00000100:00100000:0.0:1788666167.730980:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290579880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+17:9709:x1875552173576320:12345-192.168.201.25@tcp:101:rm.0 Request processed in 1104us (1651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666167.730989:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 29 00000100:00100000:3.0:1788666167.734393:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666167.734496:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173576576 00000100:00100000:1.0:1788666167.734505:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173576576 00000100:00100000:1.0:1788666167.734553:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 30 00000100:00100000:1.0:1788666167.734560:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+17:9709:x1875552173576576:12345-192.168.201.25@tcp:36:rm.0 00010000:00010000:1.0:1788666167.734637:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788666167.734664:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a000/0x96bbe788361e9ba7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428a6 expref: 17 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.734686:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361e9b53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4288a expref: 16 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.734698:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ab2908f2900) 00010000:00010000:1.0:1788666167.734713:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361e9b68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42891 expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.734722:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab2a088e800) 00010000:00010000:1.0:1788666167.734741:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788666167.734769:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854000/0x96bbe788361e9bae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.734782:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854000/0x96bbe788361e9bae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.734794:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854000/0x96bbe788361e9bae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.734807:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361e9bb5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.734813:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361e9bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.734818:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361e9bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.734958:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9bbc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.734968:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9bbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.734975:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9bbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788666167.735741:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1788666167.735755:0:5808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 274444174041ns, next at 275444171426ns, rc = 0 00010000:00010000:1.0:1788666167.735827:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9bc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.735865:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.735873:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.735879:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9bc3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.735882:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9bc3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.735886:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9bc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.735902:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788666167.735923:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9bbc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.735928:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9bbc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.735935:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9bbc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.735942:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298854200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666167.735947:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9bbc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.735954:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9bbc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.735975:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ab2908f2100) 00010000:00010000:1.0:1788666167.735978:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788666167.735984:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9bbc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.735992:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9bbc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.736007:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854000/0x96bbe788361e9bae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.736012:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854000/0x96bbe788361e9bae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.736015:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854000/0x96bbe788361e9bae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.736018:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298854000 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666167.736020:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854000/0x96bbe788361e9bae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.736023:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854000/0x96bbe788361e9bae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.736028:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab2a088e800) 00010000:00010000:1.0:1788666167.736029:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666167.736031:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854000/0x96bbe788361e9bae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.736034:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854000/0x96bbe788361e9bae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788666167.736047:0:5808:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005841ed46 reply state 00000000d015582b transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361e9bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666167.736054:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788666167.736166:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+16:9709:x1875552173576576:12345-192.168.201.25@tcp:36:rm.0 Request processed in 1604us (1788us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788666167.736173:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 30 00010000:00010000:3.0:1788666167.736678:0:7594:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666167.736688:0:7594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9bc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.736710:0:7594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855a00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666167.736714:0:7594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9bc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.736720:0:7594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9bc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.736735:0:7594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8ab2908f2100) 00010000:00010000:3.0:1788666167.736738:0:7594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788666167.736742:0:7594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9bc3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.736748:0:7594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9bc3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.736773:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666167.736774:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666167.736776:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666167.740461:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00010000:00010000:2.0:1788666167.740542:0:3261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361e9bb5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.740556:0:3261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361e9bb5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.740564:0:3261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361e9bb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.740617:0:3261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855000 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666167.740623:0:3261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361e9bb5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.740632:0:3261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361e9bb5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.740650:0:3261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x9f0a7a27 (ffff8ab2908f2700) 00010000:00010000:2.0:1788666167.740653:0:3261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666167.740658:0:3261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361e9bb5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666167.740665:0:3261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361e9bb5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x9f0a7a27 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666167.740797:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173576832 00000100:00100000:3.0:1788666167.740808:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173576832 00000100:00100000:3.0:1788666167.740893:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:3.0:1788666167.740905:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+15:9709:x1875552173576832:12345-192.168.201.25@tcp:35:rm.0 00000100:00100000:3.0:1788666167.741221:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+16:9709:x1875552173576832:12345-192.168.201.25@tcp:35:rm.0 Request processed in 318us (771us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788666167.741229:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:1.0:1788666167.744661:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666167.744757:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173577088 00000100:00100000:3.0:1788666167.744770:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173577088 00000100:00100000:3.0:1788666167.744835:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:3.0:1788666167.744859:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+16:9709:x1875552173577088:12345-192.168.201.25@tcp:36:rm.0 00010000:00010000:3.0:1788666167.744956:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788666167.744986:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9b84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4289f expref: 16 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.745009:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361e9b22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4287c expref: 15 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.745020:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab2a088e800) 00010000:00010000:3.0:1788666167.745037:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2a1d7ca00/0x96bbe788361e9ae3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4286e expref: 14 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.745046:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2908f2400) 00010000:00010000:3.0:1788666167.745052:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788666167.745080:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9bca lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.745094:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9bca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.745104:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9bca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.745117:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9bd1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.745123:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9bd1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.745129:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9bd1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.745430:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe800/0x96bbe788361e9bd8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.745440:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe800/0x96bbe788361e9bd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.745447:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe800/0x96bbe788361e9bd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666167.746116:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788666167.746137:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe800/0x96bbe788361e9bd8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.746145:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe800/0x96bbe788361e9bd8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.746152:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe800/0x96bbe788361e9bd8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.746158:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814fe800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666167.746163:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe800/0x96bbe788361e9bd8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.746171:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe800/0x96bbe788361e9bd8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.746185:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8ab2b9e72700) 00010000:00010000:3.0:1788666167.746188:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788666167.746193:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe800/0x96bbe788361e9bd8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.746211:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe800/0x96bbe788361e9bd8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.746237:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9bca lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.746243:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9bca lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.746249:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9bca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.746254:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666167.746258:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9bca lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.746264:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9bca lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.746273:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2b9e72500) 00010000:00010000:3.0:1788666167.746275:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666167.746277:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9bca lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666167.746283:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9bca lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788666167.746294:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d8b655ab reply state 00000000e02e45e6 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9bd1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666167.746303:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788666167.746437:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290578700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+15:9709:x1875552173577088:12345-192.168.201.25@tcp:36:rm.0 Request processed in 1575us (1784us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1788666167.746446:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 31 00010000:00010000:1.0:1788666167.751118:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9bd1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.751140:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9bd1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.751148:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9bd1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.751154:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814fe600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666167.751160:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9bd1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.751168:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9bd1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.751186:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8ab2b9e72900) 00010000:00010000:1.0:1788666167.751189:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666167.751194:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9bd1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666167.751200:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9bd1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666168.327996:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666168.328045:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666168.328086:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666168.328119:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666168.328239:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173577216 00000100:00100000:2.0:1788666168.328250:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173577216 00000100:00100000:2.0:1788666168.328318:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 249 00000100:00100000:2.0:1788666168.328329:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173577216:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666168.328422:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286550050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173577216:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 93us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666168.328430:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 249 00000100:00100000:2.0:1788666168.328468:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173577344 00000100:00100000:2.0:1788666168.328472:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173577344 00000100:00100000:2.0:1788666168.328498:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173577600 00000100:00100000:2.0:1788666168.328500:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173577600 00000100:00080000:1.0:1788666168.328536:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666168.328537:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 99 00000100:00100000:2.0:1788666168.328543:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+14:2364:x1875552173577344:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666168.328557:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 100 00000100:00100000:1.0:1788666168.328564:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173577600:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666168.328634:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290578380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173577600:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 70us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666168.328640:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 100 00000100:00100000:3.0:1788666168.328804:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173577472 00000100:00100000:3.0:1788666168.328809:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173577472 00000100:00100000:3.0:1788666168.328865:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 58 00000100:00100000:3.0:1788666168.328873:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29057aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+5:2364:x1875552173577472:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666168.329123:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290578a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+14:2364:x1875552173577344:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 578us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666168.329130:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 99 00000100:00100000:3.0:1788666168.329731:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29057aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+5:2364:x1875552173577472:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 856us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666168.329740:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 58 00010000:00010000:2.0:1788666168.336574:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666169.355403:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666169.739015:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186193152:0@lo:400:kworker.0 00000100:00100000:0.0:1788666169.739035:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186193408:0@lo:400:kworker.0 00000100:00100000:3.0:1788666169.739119:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186193024:0@lo:400:kworker.0 00000100:00100000:1.0:1788666169.739196:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186193280:0@lo:400:kworker.0 00000100:00100000:2.0:1788666169.741068:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666169.741187:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186193664:0@lo:400:kworker.0 00000100:00100000:2.0:1788666169.741244:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666169.741315:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186193152 00000100:00100000:2.0:1788666169.741328:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186193152 00000100:00100000:2.0:1788666169.741390:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788666169.741399:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186193152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666169.741466:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186193152:12345-0@lo:400:kworker.0 Request processed in 68us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666169.741473:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788666169.741498:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186193664 00000100:00100000:2.0:1788666169.741501:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186193664 00000100:00100000:2.0:1788666169.741538:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788666169.741544:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186193664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666169.741576:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186193664:12345-0@lo:400:kworker.0 Request processed in 32us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666169.741602:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1788666169.741627:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788666169.741667:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bf9dbb80 x1875552186193664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666169.741682:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186193664:0@lo:400:kworker.0 00000100:00100000:2.0:1788666169.741713:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186193152:0@lo:400:kworker.0 00000100:00100000:0.0:1788666169.744003:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666169.744106:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186193408 00000100:00100000:2.0:1788666169.744117:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186193408 00000100:00100000:2.0:1788666169.744199:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788666169.744211:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186193408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666169.744286:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186193408:12345-0@lo:400:kworker.0 Request processed in 77us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666169.744293:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1788666169.744368:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788666169.744407:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bf9d8a80 x1875552186193408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666185 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666169.744424:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186193408:0@lo:400:kworker.0 00000100:00100000:3.0:1788666169.754222:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666169.754291:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186193536:0@lo:400:kworker.0 00000100:00100000:3.0:1788666169.754344:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666169.757344:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186193024 00000100:00100000:2.0:1788666169.757370:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186193024 00000100:00100000:2.0:1788666169.757468:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788666169.757482:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186193024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666169.757654:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286553850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186193024:12345-0@lo:400:kworker.0 Request processed in 175us (3439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666169.757662:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788666169.757712:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186193536 00000100:00100000:2.0:1788666169.757718:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186193536 00000100:00100000:2.0:1788666169.757774:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788666169.757782:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186193536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666169.757843:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186193536:12345-0@lo:400:kworker.0 Request processed in 63us (3498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666169.757849:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1788666169.758031:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666169.758974:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186193024:0@lo:400:kworker.0 00000100:00100000:3.0:1788666169.759003:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186193536:0@lo:400:kworker.0 00000100:00100000:1.0:1788666169.759341:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666169.759453:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186193280 00000100:00100000:3.0:1788666169.759463:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186193280 00000100:00100000:3.0:1788666169.759546:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788666169.759556:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29057bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186193280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666169.759650:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29057bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186193280:12345-0@lo:400:kworker.0 Request processed in 95us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666169.759658:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:1.0:1788666169.759729:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788666169.759753:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186193280:0@lo:400:kworker.0 00000100:00100000:3.0:1788666170.251081:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788666170.251120:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186193792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788666170.251201:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666170.251283:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186193792 00000100:00100000:3.0:1788666170.251290:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186193792 00000100:00100000:3.0:1788666170.251346:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788666170.251356:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186193792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788666170.253005:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666170.253144:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186193792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1785us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666170.253158:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:0.0:1788666170.254170:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bfa61c00 x1875552186193792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666170.254203:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186193792:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788666170.380693:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788666171.276777:0:6676:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 277985192030ns, next at 278985188458ns, rc = 0 00000100:00100000:0.0:1788666171.277545:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab290579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186193920:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788666171.277685:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666171.279128:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186193920 00000100:00100000:3.0:1788666171.279146:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186193920 00000100:00100000:3.0:1788666171.279262:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788666171.279280:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186193920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788666171.279337:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666171.279456:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186193920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 183us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666171.279464:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1788666171.280520:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788666171.280671:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab290579c00 x1875552186193920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666187 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666171.280696:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab290579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186193920:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788666171.403130:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666172.426932:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788666172.700934:0:11581:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:3.0:1788666172.888178:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000004:00080000:3.0:1788666172.888198:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:3.0:1788666172.888214:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:3.0:1788666172.888216:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1788666172.888238:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1788666172.888400:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788666172.888429:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186194048:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788666172.888533:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666172.888735:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186194048 00000100:00100000:2.0:1788666172.888744:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186194048 00000100:00100000:2.0:1788666172.888824:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788666172.888835:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186194048:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788666172.888870:0:6650:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1788666172.888911:0:6650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9ce138, atime: 0x6a9ce138, ctime: 0x6a9ce138, blocks: 0x1 00010000:00010000:2.0:1788666172.888921:0:6650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1e10497/0x96bbe788361e9bdf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666172.888942:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=279s v=(0 0) 00010000:00010000:2.0:1788666172.888947:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666172.888954:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1e10497/0x96bbe788361e9bdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666172.888973:0:6650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1e10497/0x96bbe788361e9bdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666172.888985:0:6650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1e10497/0x96bbe788361e9bdf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666172.888993:0:6650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1e10497/0x96bbe788361e9bdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666172.889008:0:6650:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788666172.889679:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3276:x1875552186194048:12345-0@lo:6:osp-syn-0-0.0 Request processed in 842us (1143us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788666172.889701:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1788666172.890114:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666172.890125:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1e10497/0x96bbe788361e9bdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666172.890150:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2600 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666172.890156:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1e10497/0x96bbe788361e9bdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666172.890168:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1e10497/0x96bbe788361e9bdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666172.890193:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1e10497/0x96bbe788361e9bdf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666172.890203:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1e10497/0x96bbe788361e9bdf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666172.890228:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666172.890230:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666172.890231:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788666172.890613:0:3276:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab2b4229c00/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788666172.890622:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186194048:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788666173.450212:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666173.450306:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173577728 00000100:00100000:3.0:1788666173.450318:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173577728 00000100:00100000:3.0:1788666173.450394:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 251 00000100:00100000:3.0:1788666173.450406:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173577728:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666173.450496:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286553450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173577728:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 92us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666173.450504:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 251 00010000:00010000:0.0:1788666173.451871:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666173.452552:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666173.458327:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173577856 00000100:00100000:3.0:1788666173.458348:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173577856 00000100:00100000:3.0:1788666173.458613:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 104 00000100:00100000:3.0:1788666173.458626:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+5:2364:x1875552173577856:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666173.458736:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290578000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+5:2364:x1875552173577856:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 113us (6190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666173.458775:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 104 00000100:00080000:0.0:1788666173.463706:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666173.463803:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666173.463845:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666173.463880:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173577984 00000100:00100000:0.0:1788666173.463895:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173577984 00000100:00100000:0.0:1788666173.463993:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:0.0:1788666173.464008:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+5:2364:x1875552173577984:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666173.464115:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+5:2364:x1875552173577984:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 111us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666173.464123:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00080000:0.0:1788666173.464145:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788666173.464478:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173578112 00000100:00100000:3.0:1788666173.464487:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173578112 00000100:00100000:3.0:1788666173.464676:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 105 00000100:00100000:3.0:1788666173.464690:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84416489-fb20-4430-94f5-31470edbb54e+5:2363:x1875552173578112:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666173.464731:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84416489-fb20-4430-94f5-31470edbb54e+5:2363:x1875552173578112:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 47us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666173.464738:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 105 00000100:00080000:0.0:1788666173.467250:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1788666173.941911:0:11631:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffced0f9d00 20000000:00000080:1.0:1788666173.941933:0:11631:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab290489c00 uarg=0000000000000000 20000000:01000000:1.0:1788666173.941971:0:11631:0:(mgs_llog.c:6191:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788666173.941978:0:11631:0:(mgs_llog.c:4646:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788666173.941982:0:11631:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1788666173.943641:0:11632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1788666173.944121:0:11631:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788666173.949189:0:11631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788666173.949271:0:11631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788666173.949332:0:11631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788666173.949352:0:11631:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788666173.949378:0:11631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab2b47f3200/0x96bbe788361e9be6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666173.949402:0:11631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab2a1d7ce00/0x96bbe788361e9a81 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42859 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666173.949410:0:11631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab2a1d7de00/0x96bbe788361e9a88 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42860 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666173.949419:0:11631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a96 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9a8f expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666173.949425:0:11631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab2a1d7c000/0x96bbe788361e9aa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9a9d expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666173.949432:0:11631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab28144b800/0x96bbe788361e9ab2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9aab expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666173.949439:0:11631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab2b47f3200/0x96bbe788361e9be6 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666173.949484:0:11631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab28144b800/0x96bbe788361e9ab2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e9aab expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666173.949506:0:11631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab28144b800/0x96bbe788361e9ab2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e9aab expref: 18 pid: 5801 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666173.949536:0:11631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b422b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1875552186194176:0@lo:104: 00000100:00100000:2.0:1788666173.949668:0:11631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788666173.949731:0:11631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab2a1d7c000/0x96bbe788361e9aa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e9a9d expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666173.949752:0:11631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab2a1d7c000/0x96bbe788361e9aa4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e9a9d expref: 18 pid: 5802 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666173.949760:0:11631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1875552186194304:0@lo:104: 00000100:00100000:2.0:1788666173.949781:0:11631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788666173.949817:0:11631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a96 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361e9a8f expref: 18 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666173.949824:0:11631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361e9a8f expref: 18 pid: 5800 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666173.949831:0:11631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1875552186194432:0@lo:104: 00000100:00100000:2.0:1788666173.949853:0:11631:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788666173.949869:0:11631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab2a1d7de00/0x96bbe788361e9a88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42860 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666173.949879:0:11631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab2a1d7de00/0x96bbe788361e9a88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42860 expref: 12 pid: 5800 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666173.949888:0:11631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1875552186194560:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666173.949956:0:11631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab2a1d7ce00/0x96bbe788361e9a81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42859 expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666173.949977:0:11631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab2a1d7ce00/0x96bbe788361e9a81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42859 expref: 12 pid: 5800 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666173.949987:0:11631:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1875552186194688:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788666173.950012:0:11631:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bbe86600 going to sleep for 11 seconds 00000100:00100000:0.0:1788666173.950114:0:5792:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788666173.950127:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186194176 00000100:00100000:0.0:1788666173.950135:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186194176 00000100:00100000:0.0:1788666173.950180:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186194304 00000100:00100000:0.0:1788666173.950184:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186194304 00000100:00100000:0.0:1788666173.950194:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186194432 00000100:00100000:0.0:1788666173.950196:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186194432 00000100:00100000:0.0:1788666173.950209:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788666173.950218:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b422a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:633727f4-1aad-4438-919b-34cfb144e459+5:11631:x1875552186194176:12345-0@lo:104: 00010000:00010000:0.0:1788666173.950231:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9aab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.950303:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788666173.950309:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b422a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:633727f4-1aad-4438-919b-34cfb144e459+5:11631:x1875552186194176:12345-0@lo:104: Request processed in 92us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666173.950325:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788666173.950341:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788666173.950346:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:633727f4-1aad-4438-919b-34cfb144e459+4:11631:x1875552186194304:12345-0@lo:104: 00010000:00010000:0.0:1788666173.950354:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9a9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.950390:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788666173.950395:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:633727f4-1aad-4438-919b-34cfb144e459+4:11631:x1875552186194304:12345-0@lo:104: Request processed in 49us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666173.950401:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788666173.950411:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788666173.950416:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae4f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:633727f4-1aad-4438-919b-34cfb144e459+3:11631:x1875552186194432:12345-0@lo:104: 00010000:00010000:0.0:1788666173.950423:0:5792:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.950450:0:5792:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788666173.950455:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae4f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:633727f4-1aad-4438-919b-34cfb144e459+3:11631:x1875552186194432:12345-0@lo:104: Request processed in 39us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666173.950460:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788666173.950683:0:7594:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788666173.950691:0:7594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9aab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.950698:0:7594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144b200 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:0.0:1788666173.950704:0:7594:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9aab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e9ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.950727:0:7594:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9aab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e9ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788666173.950751:0:7594:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9aab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e9ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666173.950758:0:7594:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788666173.950802:0:7594:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9aab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.950810:0:7594:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788666173.950835:0:7594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9aab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.950843:0:7594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9aab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9ab2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.950863:0:7594:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788666173.950866:0:7594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9a9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.950871:0:7594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ffc00 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:0.0:1788666173.950875:0:7594:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9a9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e9aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.950881:0:7594:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9a9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e9aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788666173.950888:0:7594:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9a9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e9aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666173.950900:0:7594:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788666173.950915:0:7594:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9a9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.950920:0:7594:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788666173.950940:0:7594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9a9d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.950946:0:7594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab2814ffc00/0x96bbe788361e9a9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9aa4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.950956:0:7594:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666173.950959:0:7594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361e9a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.950965:0:7594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7d200 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:0.0:1788666173.950968:0:7594:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a8f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361e9a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.950975:0:7594:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361e9a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788666173.950982:0:7594:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a8f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361e9a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666173.950993:0:7594:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788666173.951008:0:7594:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a8f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.951013:0:7594:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788666173.951027:0:7594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a8f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.951033:0:7594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7d200/0x96bbe788361e9a8f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361e9a96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.951050:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666173.951052:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666173.951054:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666173.951062:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666173.951068:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666173.951081:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186194816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788666173.951116:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666173.951162:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186194944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788666173.951184:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666173.951201:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788666173.951206:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186195072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788666173.951230:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666173.951260:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186194816 00000100:00100000:0.0:1788666173.951266:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186194816 00010000:00010000:0.0:1788666173.951288:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab28144b800/0x96bbe788361e9ab2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9aab expref: 19 pid: 5801 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666173.951304:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186194944 00000100:00100000:0.0:1788666173.951307:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186194944 00010000:00010000:0.0:1788666173.951319:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab2a1d7c000/0x96bbe788361e9aa4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9a9d expref: 20 pid: 5802 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666173.951329:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186195072 00000100:00100000:0.0:1788666173.951331:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186195072 00010000:00010000:0.0:1788666173.951349:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a96 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9a8f expref: 21 pid: 5800 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666173.951362:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788666173.951369:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+21:3276:x1875552186194816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788666173.951381:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666173.951387:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab28144b800/0x96bbe788361e9ab2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9aab expref: 21 pid: 5801 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.951400:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab28144b800/0x96bbe788361e9ab2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e9aab expref: 21 pid: 5801 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.951420:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666173.951450:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+21:3276:x1875552186194816:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666173.951457:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788666173.951470:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788666173.951476:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+20:3277:x1875552186194944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788666173.951484:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666173.951488:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab2a1d7c000/0x96bbe788361e9aa4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9a9d expref: 20 pid: 5802 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.951498:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab2a1d7c000/0x96bbe788361e9aa4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e9a9d expref: 20 pid: 5802 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.951508:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666173.951539:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+20:3277:x1875552186194944:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666173.951545:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788666173.951563:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788666173.951569:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b9dd3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+19:3277:x1875552186195072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788666173.951577:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666173.951609:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a96 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361e9a8f expref: 19 pid: 5800 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.951619:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a96 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361e9a8f expref: 19 pid: 5800 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.951628:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666173.951649:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b9dd3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+19:3277:x1875552186195072:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666173.951655:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788666173.951728:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186194816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788666173.951768:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186195072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788666173.951775:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186194944:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788666173.952838:0:11631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab28144b800/0x96bbe788361e9ab2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e9aab expref: 18 pid: 5801 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666173.952861:0:11631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b422b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1875552186194176:0@lo:104: 00010000:00010000:2.0:1788666173.952876:0:11631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2a1d7c000/0x96bbe788361e9aa4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e9a9d expref: 17 pid: 5802 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666173.952884:0:11631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1875552186194304:0@lo:104: 00010000:00010000:2.0:1788666173.952895:0:11631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2814ff000/0x96bbe788361e9a96 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361e9a8f expref: 16 pid: 5800 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666173.952905:0:11631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1875552186194432:0@lo:104: 00000100:00100000:1.0:1788666173.953523:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666173.953645:0:11631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1875552186194560:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788666173.953654:0:11631:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11631:1875552186194688:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666173.953695:0:11631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab2b47f3200/0x96bbe788361e9be6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666173.953781:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173578240 00000100:00100000:0.0:1788666173.953792:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173578240 00010000:00010000:0.0:1788666173.953841:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab2a1d7de00/0x96bbe788361e9a88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42860 expref: 13 pid: 5800 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666173.953887:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:0.0:1788666173.953897:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290578e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173578240:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788666173.953914:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666173.953920:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab2a1d7de00/0x96bbe788361e9a88 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42860 expref: 13 pid: 5800 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.953944:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab2a1d7de00/0x96bbe788361e9a88 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42860 expref: 13 pid: 5800 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.953966:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2a1d7de00/0x96bbe788361e9a88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42860 expref: 13 pid: 5800 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666173.953982:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666173.954036:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290578e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:2364:x1875552173578240:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 141us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666173.954043:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:0.0:1788666173.954875:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666173.954951:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173578368 00000100:00100000:3.0:1788666173.954959:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173578368 00010000:00010000:3.0:1788666173.954996:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab2a1d7ce00/0x96bbe788361e9a81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42859 expref: 12 pid: 5800 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666173.955030:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 34 00000100:00100000:3.0:1788666173.955039:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:2361:x1875552173578368:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666173.955052:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666173.955058:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab2a1d7ce00/0x96bbe788361e9a81 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42859 expref: 12 pid: 5800 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666173.955068:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab2a1d7ce00/0x96bbe788361e9a81 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42859 expref: 12 pid: 5800 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666173.955098:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2a1d7ce00/0x96bbe788361e9a81 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42859 expref: 12 pid: 5800 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666173.955118:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab2b47f3200/0x96bbe788361e9be6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666173.955128:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2b47f3200/0x96bbe788361e9be6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666173.955161:0:5793:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab2b47f3200/0x96bbe788361e9be6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666173.955170:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab2b47f3200/0x96bbe788361e9be6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666173.955178:0:5793:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab2b47f3200/0x96bbe788361e9be6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666173.955186:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab2b47f3200/0x96bbe788361e9be6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666173.955193:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3200 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666173.955197:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab2b47f3200/0x96bbe788361e9be6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666173.955206:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab2b47f3200/0x96bbe788361e9be6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666173.955226:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab2b47f3200/0x96bbe788361e9be6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666173.955245:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666173.955295:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17385a9f-d911-4baa-b21a-4b6dd266f57e+11:2361:x1875552173578368:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 256us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666173.955303:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 34 00010000:00010000:2.0:1788666173.955455:0:11631:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab2b47f3200/0x96bbe788361e9be6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666173.955464:0:11631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab2b47f3200/0x96bbe788361e9be6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666173.955477:0:11631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2b47f3200/0x96bbe788361e9be6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666174.481931:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666174.865251:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788666174.865330:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788666174.865360:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab290579f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186195328:0@lo:400:kworker.0 00000100:00100000:0.0:1788666174.865480:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666174.865692:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186195328 00000100:00100000:3.0:1788666174.865705:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186195328 00000100:00100000:3.0:1788666174.865798:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788666174.865810:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186195328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666174.865883:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186195328:12345-0@lo:400:kworker.0 Request processed in 75us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666174.865891:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788666174.865932:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab290579f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186195328:0@lo:400:kworker.0 00000100:00100000:2.0:1788666174.873125:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab29057b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186195200:0@lo:400:kworker.0 00000100:00100000:2.0:1788666174.873232:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666174.873687:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186195200 00000100:00100000:3.0:1788666174.873701:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186195200 00000100:00100000:3.0:1788666174.873787:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788666174.873797:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+16:3276:x1875552186195200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666174.873869:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286550850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+16:3276:x1875552186195200:12345-0@lo:400:kworker.0 Request processed in 74us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666174.873877:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788666174.874007:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab29057b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186195200:0@lo:400:kworker.0 00000100:00100000:3.0:1788666174.881670:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab290579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186195712:0@lo:400:kworker.0 00000100:00100000:0.0:1788666174.881714:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab29057b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186195456:0@lo:400:kworker.0 00000100:00100000:1.0:1788666174.881835:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab29057a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186195840:0@lo:400:kworker.0 00000100:00100000:2.0:1788666174.884330:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab290579f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186195584:0@lo:400:kworker.0 00000100:00100000:3.0:1788666174.889845:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666174.889968:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186195712 00000100:00100000:3.0:1788666174.889980:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186195712 00000100:00100000:3.0:1788666174.890061:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788666174.890987:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186195712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666174.891228:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186195712:12345-0@lo:400:kworker.0 Request processed in 1157us (1391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666174.891239:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1788666174.891279:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666174.891333:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab290579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186195712:0@lo:400:kworker.0 00000100:00100000:0.0:1788666174.894018:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666174.894235:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186195456 00000100:00100000:3.0:1788666174.894246:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186195456 00000100:00100000:3.0:1788666174.894347:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788666174.894359:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186195456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666174.894493:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186195456:12345-0@lo:400:kworker.0 Request processed in 137us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666174.894500:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1788666174.894747:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666174.894797:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab29057b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186195456:0@lo:400:kworker.0 00000100:00100000:3.0:1788666174.898678:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666174.898923:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186195840 00000100:00100000:0.0:1788666174.898935:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186195840 00000100:00100000:0.0:1788666174.899018:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788666174.899030:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186195840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666174.899114:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186195840:12345-0@lo:400:kworker.0 Request processed in 87us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666174.899141:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788666174.902009:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666174.902218:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186195584 00000100:00100000:0.0:1788666174.902230:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186195584 00000100:00100000:0.0:1788666174.902324:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788666174.902336:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1875552186195584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666174.902420:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1875552186195584:12345-0@lo:400:kworker.0 Request processed in 87us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666174.902427:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1788666174.902554:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788666174.902559:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788666174.902703:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab290579f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186195584:0@lo:400:kworker.0 00010000:00080000:3.0:1788666174.912496:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab29057a680 x1875552186195840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666190 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666174.912519:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab29057a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186195840:0@lo:400:kworker.0 00000100:00100000:3.0:1788666175.371826:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788666175.371863:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186195968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788666175.371970:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666175.372050:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186195968 00000100:00100000:3.0:1788666175.372058:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186195968 00000100:00100000:3.0:1788666175.372111:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788666175.372120:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186195968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788666175.372158:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666175.372222:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186195968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666175.372229:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1788666175.372274:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bfa61f80 x1875552186195968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666175.372298:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186195968:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1788666175.434752:0:5804:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:0.0:1788666175.434763:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff8ab2bbf65000 from 7 10000000:01000000:0.0:1788666175.434769:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788666175.434827:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9bed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666175.434842:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9bed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666175.434855:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9bed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666175.434889:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186196096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788666175.434981:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666175.435063:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2aea25900 going to sleep for 11 seconds 00000100:00100000:2.0:1788666175.435246:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186196096 00000100:00100000:2.0:1788666175.435255:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186196096 00000100:00100000:2.0:1788666175.435311:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788666175.435320:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+16:5804:x1875552186196096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788666175.435336:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666175.435352:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2b47f3200/0x96bbe788361e9bf4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e9bed expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666175.435378:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2b47f3200/0x96bbe788361e9bf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e9bed expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666175.435390:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2b47f3200/0x96bbe788361e9bf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9bed expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666175.435401:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f3200, rc 0) 00000100:00100000:2.0:1788666175.435454:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286553050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186196096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666175.435479:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788666175.436257:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186196096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788666175.436276:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9bed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9bf4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666175.436297:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9bed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9bf4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666175.436381:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186196224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666175.436421:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666175.436459:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2aea25900 going to sleep for 11 seconds 00000100:00100000:2.0:1788666175.436680:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186196224 00000100:00100000:2.0:1788666175.436687:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186196224 00000100:00100000:2.0:1788666175.436736:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788666175.436744:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186196224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788666175.449433:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286551450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186196224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 12669us (12990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666175.449456:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788666175.449895:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186196224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666175.449983:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186196352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788666175.450045:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666175.450106:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2aea25900 going to sleep for 11 seconds 00000100:00100000:3.0:1788666175.452045:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186196352 00000100:00100000:3.0:1788666175.452074:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186196352 00000100:00100000:3.0:1788666175.452148:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788666175.452159:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab286551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186196352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788666175.452613:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab286551050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186196352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 422us (2533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666175.452622:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788666175.453716:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9d9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186196352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788666175.454527:0:11645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa61f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:11645:1875552186196480:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788666175.455476:0:11645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666175.455535:0:11645:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab286278cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788666175.455630:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186196480 00000100:00100000:0.0:1788666175.455640:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186196480 00000100:00100000:0.0:1788666175.455701:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788666175.455721:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+17:11645:x1875552186196480:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788666175.457432:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+17:11645:x1875552186196480:12345-0@lo:502:llog_process_th.0 Request processed in 1701us (1947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666175.457446:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788666175.459355:0:11645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa61f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:11645:1875552186196480:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788666175.459417:0:11645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666175.459432:0:11645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666175.459434:0:11645:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788666175.459442:0:11645:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab2bbf65000 00000020:00000080:3.0:1788666175.459444:0:11645:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788666175.459563:0:11645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa61f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:11645:1875552186196608:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788666175.459694:0:11645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666175.459760:0:11645:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab286278cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788666175.464035:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186196608 00000100:00100000:0.0:1788666175.464064:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186196608 00000100:00100000:0.0:1788666175.464131:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788666175.464140:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+17:11645:x1875552186196608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788666175.464529:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+17:11645:x1875552186196608:12345-0@lo:502:llog_process_th.0 Request processed in 389us (4835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666175.464537:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788666175.466260:0:11645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa61f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:11645:1875552186196608:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788666175.466338:0:11645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788666175.466350:0:11645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666175.466353:0:11645:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788666175.466359:0:11645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788666175.467373:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788666175.467405:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788666175.467421:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9bed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9bf4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666175.467445:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9bed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9bf4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666175.467460:0:5804:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:0.0:1788666175.467462:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff8ab2bcd59800 from 7 10000000:01000000:0.0:1788666175.467465:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788666175.467512:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab28144a000/0x96bbe788361e9bfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666175.467520:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab28144a000/0x96bbe788361e9bfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666175.467531:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab28144a000/0x96bbe788361e9bfb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666175.467558:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186196736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788666175.467675:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666175.473173:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2aea25900 going to sleep for 11 seconds 00000100:00100000:3.0:1788666175.483210:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186196736 00000100:00100000:3.0:1788666175.483234:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186196736 00000100:00100000:3.0:1788666175.483327:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788666175.483341:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+17:5804:x1875552186196736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666175.483370:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666175.483396:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2814fe800/0x96bbe788361e9c02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e9bfb expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666175.483432:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2814fe800/0x96bbe788361e9c02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e9bfb expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666175.483447:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2814fe800/0x96bbe788361e9c02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9bfb expref: 18 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666175.483458:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814fe800, rc 0) 00000100:00100000:3.0:1788666175.483577:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186196736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 239us (15902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666175.483604:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788666175.483703:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186196736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666175.483741:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab28144a000/0x96bbe788361e9bfb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9c02 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666175.483753:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab28144a000/0x96bbe788361e9bfb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9c02 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666175.483855:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186196864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788666175.486277:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666175.486404:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab286278180 going to sleep for 11 seconds 00000100:00100000:1.0:1788666175.504792:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186196864 00000100:00100000:1.0:1788666175.504812:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186196864 00000100:00100000:1.0:1788666175.504891:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788666175.504904:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186196864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788666175.505280:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186196864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 377us (19006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666175.505288:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788666175.505503:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa61500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186196864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788666175.505561:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186196992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788666175.505645:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666175.505683:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bbe86600 going to sleep for 11 seconds 00000100:00100000:2.0:1788666175.505721:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186196992 00000100:00100000:2.0:1788666175.505727:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186196992 00000100:00100000:2.0:1788666175.505759:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788666175.505766:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186196992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788666175.505919:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186196992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666175.505925:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788666175.505965:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186196992:0@lo:503:ll_cfg_requeue.0 00010000:00010000:0.0:1788666175.508022:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666175.509145:0:11648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:11648:1875552186197120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788666175.509236:0:11648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666175.509292:0:11648:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bbe86240 going to sleep for 11 seconds 00000100:00100000:0.0:1788666175.509402:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186197120 00000100:00100000:0.0:1788666175.509412:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186197120 00000100:00100000:0.0:1788666175.509466:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788666175.509476:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+18:11648:x1875552186197120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788666175.509776:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+18:11648:x1875552186197120:12345-0@lo:502:llog_process_th.0 Request processed in 300us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666175.509785:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788666175.509918:0:11648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:11648:1875552186197120:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788666175.509950:0:11648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788666175.509961:0:11648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666175.509964:0:11648:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788666175.509972:0:11648:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab2bcd59800 00000020:00000080:2.0:1788666175.509975:0:11648:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788666175.510071:0:11648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:11648:1875552186197248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788666175.510110:0:11648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666175.510132:0:11648:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bbe86240 going to sleep for 11 seconds 00000100:00100000:1.0:1788666175.510303:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186197248 00000100:00100000:1.0:1788666175.510309:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186197248 00000100:00100000:1.0:1788666175.510353:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788666175.510361:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+18:11648:x1875552186197248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788666175.510512:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+18:11648:x1875552186197248:12345-0@lo:502:llog_process_th.0 Request processed in 152us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666175.510519:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788666175.510639:0:11648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:11648:1875552186197248:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788666175.510659:0:11648:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788666175.510663:0:11648:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666175.510665:0:11648:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788666175.510669:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788666175.510857:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788666175.510888:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788666175.510898:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab28144a000/0x96bbe788361e9bfb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9c02 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666175.510909:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab28144a000/0x96bbe788361e9bfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9c02 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666175.510919:0:5804:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1788666175.510922:0:5804:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff8ab290a54800 from 7 10000000:01000000:1.0:1788666175.510925:0:5804:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788666175.510959:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab298854800/0x96bbe788361e9c09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666175.510969:0:5804:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab298854800/0x96bbe788361e9c09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666175.510978:0:5804:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab298854800/0x96bbe788361e9c09 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666175.510991:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab29057a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186197376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788666175.511022:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666175.511051:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bf992480 going to sleep for 11 seconds 00000100:00100000:2.0:1788666175.511208:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186197376 00000100:00100000:2.0:1788666175.511214:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186197376 00000100:00100000:2.0:1788666175.511247:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788666175.511253:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+18:5804:x1875552186197376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788666175.511262:0:5801:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666175.511275:0:5801:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2b47f2000/0x96bbe788361e9c10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361e9c09 expref: -99 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666175.511297:0:5801:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2b47f2000/0x96bbe788361e9c10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361e9c09 expref: 19 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666175.511308:0:5801:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2b47f2000/0x96bbe788361e9c10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361e9c09 expref: 19 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666175.511328:0:5801:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2000, rc 0) 00000100:00100000:2.0:1788666175.511361:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:5804:x1875552186197376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666175.511367:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1788666175.511433:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab29057a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186197376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788666175.511448:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab298854800/0x96bbe788361e9c09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9c10 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666175.511457:0:5804:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab298854800/0x96bbe788361e9c09 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9c10 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666175.511503:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab29057a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186197504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788666175.511526:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666175.511547:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bf992480 going to sleep for 11 seconds 00000100:00100000:0.0:1788666175.520702:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186197504 00000100:00100000:0.0:1788666175.520740:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186197504 00000100:00100000:0.0:1788666175.520846:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788666175.520858:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28561d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:5804:x1875552186197504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666175.521281:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28561d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:5804:x1875552186197504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 427us (9753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666175.521291:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788666175.521600:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab29057a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186197504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788666175.521672:0:5804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab29057a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186197632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788666175.521739:0:5804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666175.521783:0:5804:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bf992480 going to sleep for 11 seconds 00000100:00100000:0.0:1788666175.529237:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186197632 00000100:00100000:0.0:1788666175.529257:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186197632 00000100:00100000:0.0:1788666175.529347:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788666175.529361:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:5804:x1875552186197632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788666175.529741:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:5804:x1875552186197632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 381us (8000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666175.529750:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788666175.529891:0:5804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab29057a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:633727f4-1aad-4438-919b-34cfb144e459:5804:1875552186197632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788666175.531483:0:11649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab29057a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:11649:1875552186197760:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788666175.531567:0:11649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666175.531630:0:11649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bf992f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666175.531718:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186197760 00000100:00100000:2.0:1788666175.531727:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186197760 00000100:00100000:2.0:1788666175.531769:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788666175.531778:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298878850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:11649:x1875552186197760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788666175.532024:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298878850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:11649:x1875552186197760:12345-0@lo:502:llog_process_th.0 Request processed in 247us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666175.532032:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788666175.532171:0:11649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab29057a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:11649:1875552186197760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788666175.532198:0:11649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788666175.532209:0:11649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666175.532211:0:11649:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788666175.532217:0:11649:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab290a54800 00000020:00000080:1.0:1788666175.532220:0:11649:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788666175.532297:0:11649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab29057a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:11649:1875552186197888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788666175.532332:0:11649:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666175.532356:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186197888 00000100:00100000:1.0:1788666175.532360:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186197888 00000100:00100000:1.0:1788666175.532379:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788666175.532386:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:11649:x1875552186197888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788666175.532516:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:11649:x1875552186197888:12345-0@lo:502:llog_process_th.0 Request processed in 129us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666175.532523:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788666175.532559:0:11649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bf992f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788666175.532570:0:11649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab29057a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:633727f4-1aad-4438-919b-34cfb144e459:11649:1875552186197888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788666175.532604:0:11649:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788666175.532609:0:11649:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666175.532610:0:11649:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788666175.532614:0:11649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788666175.533197:0:5804:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788666175.533219:0:5804:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788666175.533230:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab298854800/0x96bbe788361e9c09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9c10 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666175.533241:0:5804:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab298854800/0x96bbe788361e9c09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9c10 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788666175.538485:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788666175.821367:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666175.821637:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173578496 00000100:00100000:2.0:1788666175.821652:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173578496 00000100:00100000:2.0:1788666175.821739:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 268 00000100:00100000:2.0:1788666175.821752:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+11:5603:x1875552173578496:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788666175.821780:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666175.821804:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2b47f3000/0x96bbe788361e9c17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d428ad expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666175.821848:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2b47f3000/0x96bbe788361e9c17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428ad expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666175.821862:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2b47f3000/0x96bbe788361e9c17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428ad expref: 12 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666175.821874:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f3000, rc 0) 00000100:00100000:2.0:1788666175.821992:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298879450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:5603:x1875552173578496:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 243us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666175.822000:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 268 00000100:00100000:1.0:1788666175.835541:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666175.836011:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173578624 00000100:00100000:0.0:1788666175.836025:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173578624 00000100:00100000:0.0:1788666175.836161:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 269 00000100:00100000:0.0:1788666175.836174:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:5603:x1875552173578624:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666175.839229:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298879050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:5603:x1875552173578624:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 876us (1912us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666175.839291:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 269 00000100:00100000:0.0:1788666175.846879:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666175.847016:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173578752 00000100:00100000:1.0:1788666175.847030:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173578752 00000100:00100000:1.0:1788666175.847116:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 270 00000100:00100000:1.0:1788666175.847128:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:5603:x1875552173578752:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788666175.848023:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:5603:x1875552173578752:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 Request processed in 890us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666175.848035:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 270 00000100:00100000:1.0:1788666175.862206:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666175.862321:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173578880 00000100:00100000:0.0:1788666175.862339:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173578880 00000100:00100000:0.0:1788666175.862420:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 271 00000100:00100000:0.0:1788666175.862430:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:9981:x1875552173578880:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788666175.863041:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298879c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:9981:x1875552173578880:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 609us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666175.863052:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 271 00000100:00100000:2.0:1788666175.885572:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666175.886005:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173579008 00000100:00100000:1.0:1788666175.886019:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173579008 00000100:00100000:1.0:1788666175.886104:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 272 00000100:00100000:1.0:1788666175.886118:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:9981:x1875552173579008:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788666175.888239:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:9981:x1875552173579008:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 2108us (2688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666175.888257:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 272 00000100:00100000:1.0:1788666175.902196:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666175.904131:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173579136 00000100:00100000:2.0:1788666175.904152:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173579136 00000100:00100000:2.0:1788666175.904248:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 273 00000100:00100000:2.0:1788666175.904259:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:5603:x1875552173579136:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788666175.904292:0:5800:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666175.904318:0:5800:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2b47f3a00/0x96bbe788361e9c1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d428b4 expref: -99 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666175.904363:0:5800:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2b47f3a00/0x96bbe788361e9c1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428b4 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666175.904485:0:5800:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2b47f3a00/0x96bbe788361e9c1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428b4 expref: 13 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666175.904499:0:5800:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f3a00, rc 0) 00000100:00100000:2.0:1788666175.906016:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:5603:x1875552173579136:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 1748us (3823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666175.906029:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 273 00000100:00100000:2.0:1788666175.931307:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666175.931540:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173579264 00000100:00100000:1.0:1788666175.931556:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173579264 00000100:00100000:1.0:1788666175.931659:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 274 00000100:00100000:1.0:1788666175.931672:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298878450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:5603:x1875552173579264:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788666175.932444:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298878450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:5603:x1875552173579264:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 772us (1163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666175.932455:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 274 00000100:00100000:1.0:1788666175.960443:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666175.963367:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173579392 00000100:00100000:0.0:1788666175.963401:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173579392 00000100:00100000:0.0:1788666175.963504:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 275 00000100:00100000:0.0:1788666175.963521:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:5603:x1875552173579392:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788666175.972300:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298879850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:5603:x1875552173579392:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 Request processed in 8754us (11840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666175.972322:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 275 00000100:00100000:2.0:1788666175.996342:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666175.996620:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173579520 00000100:00100000:1.0:1788666175.996639:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173579520 00000100:00100000:1.0:1788666175.996732:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 276 00000100:00100000:1.0:1788666175.996745:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298878c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:9984:x1875552173579520:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788666175.997359:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298878c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:9984:x1875552173579520:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 613us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666175.997371:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 276 00000100:00100000:2.0:1788666176.002298:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666176.002450:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173579648 00000100:00100000:1.0:1788666176.002461:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173579648 00000100:00100000:1.0:1788666176.002517:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 277 00000100:00100000:1.0:1788666176.002526:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:9984:x1875552173579648:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788666176.002831:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:9984:x1875552173579648:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 305us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666176.002840:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 277 00000100:00100000:0.0:1788666176.395269:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788666176.395298:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab29057a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186198016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788666176.395389:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666176.396326:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186198016 00000100:00100000:3.0:1788666176.396337:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186198016 00000100:00100000:3.0:1788666176.396478:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788666176.396493:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1875552186198016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788666176.396550:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666176.396856:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1875552186198016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 367us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666176.396866:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788666176.397059:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788666176.397123:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab29057a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186198016:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788666176.526661:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788666176.587397:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788666177.552767:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788666178.136568:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:3.0:1788666178.563162:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666178.563218:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666178.563261:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666178.563288:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666178.563334:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173580032 00000100:00100000:3.0:1788666178.563346:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173580032 00000100:00100000:3.0:1788666178.563435:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:3.0:1788666178.563454:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+5:2361:x1875552173580032:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666178.563555:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+5:2361:x1875552173580032:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 109us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666178.563564:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00080000:3.0:1788666178.563639:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788666178.563977:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173579904 00000100:00100000:1.0:1788666178.563983:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173579904 00000100:00100000:1.0:1788666178.564031:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173580160 00000100:00100000:1.0:1788666178.564035:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173580160 00000100:00100000:1.0:1788666178.564060:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 109 00000100:00100000:1.0:1788666178.564069:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+5:2361:x1875552173579904:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666178.564112:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+5:2361:x1875552173579904:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 45us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666178.564119:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 109 00000100:00100000:1.0:1788666178.564133:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 110 00000100:00100000:1.0:1788666178.564139:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84416489-fb20-4430-94f5-31470edbb54e+5:2361:x1875552173580160:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666178.564162:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84416489-fb20-4430-94f5-31470edbb54e+5:2361:x1875552173580160:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 23us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666178.564184:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 110 00000100:00100000:2.0:1788666178.564442:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173579776 00000100:00100000:2.0:1788666178.564447:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173579776 00000100:00100000:2.0:1788666178.564491:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 278 00000100:00100000:2.0:1788666178.564498:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2361:x1875552173579776:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666178.564531:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2361:x1875552173579776:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 34us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666178.564538:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 278 00000100:00080000:3.0:1788666178.567081:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788666178.572199:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666179.595178:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666179.978873:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab290579f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186198144:0@lo:400:kworker.0 00000100:00100000:3.0:1788666179.978968:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666179.979090:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186198144 00000100:00100000:2.0:1788666179.979100:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186198144 00000100:00100000:2.0:1788666179.979165:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788666179.979165:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab29057b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186198272:0@lo:400:kworker.0 00000100:00100000:2.0:1788666179.979175:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298878050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186198144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666179.979204:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666179.979316:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186198272 00000100:00100000:0.0:1788666179.979320:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186198272 00000100:00100000:0.0:1788666179.979348:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788666179.979354:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186198272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666179.979389:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186198272:12345-0@lo:400:kworker.0 Request processed in 35us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666179.979395:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788666179.979435:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab29057b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186198272:0@lo:400:kworker.0 00000100:00100000:1.0:1788666179.982665:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186198784:0@lo:400:kworker.0 00000100:00100000:1.0:1788666179.982738:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666179.982782:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788666179.982788:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab29057a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186198656:0@lo:400:kworker.0 00000100:00100000:1.0:1788666179.982815:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666179.982851:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186198784 00000100:00100000:1.0:1788666179.982858:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186198784 00000100:00100000:1.0:1788666179.982918:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788666179.982927:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186198784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666179.982978:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186198784:12345-0@lo:400:kworker.0 Request processed in 51us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666179.982985:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788666179.983011:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186198656 00000100:00100000:1.0:1788666179.983015:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186198656 00000100:00100000:1.0:1788666179.983041:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788666179.983048:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186198656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666179.983079:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186198656:12345-0@lo:400:kworker.0 Request processed in 32us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666179.983085:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:1.0:1788666179.983102:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788666179.983107:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788666179.983138:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab29057a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186198656:0@lo:400:kworker.0 00010000:00080000:1.0:1788666179.983150:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bfaaf100 x1875552186198784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666195 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666179.983181:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186198784:0@lo:400:kworker.0 00000100:00100000:1.0:1788666179.983225:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab29057b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186198528:0@lo:400:kworker.0 00000100:00100000:1.0:1788666179.983252:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666179.983272:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788666179.983278:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab290579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186198400:0@lo:400:kworker.0 00000100:00100000:1.0:1788666179.983298:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666179.983322:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186198528 00000100:00100000:1.0:1788666179.983326:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186198528 00000100:00100000:1.0:1788666179.983360:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788666179.983367:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186198528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666179.983401:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186198528:12345-0@lo:400:kworker.0 Request processed in 34us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666179.983407:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1788666179.983423:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788666179.983437:0:3278:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1788666179.983442:0:3278:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab2b4229c00, transno 4294967300 00000100:00100000:2.0:1788666179.983452:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298878050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186198144:12345-0@lo:400:kworker.0 Request processed in 4277us (4483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666179.983452:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab29057b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186198528:0@lo:400:kworker.0 00000100:00100000:2.0:1788666179.983462:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1788666179.988055:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186198400 00000100:00100000:0.0:1788666179.988081:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186198400 00000100:00080000:2.0:1788666179.988189:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666179.988203:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788666179.988214:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186198400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666179.988342:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186198400:12345-0@lo:400:kworker.0 Request processed in 129us (5042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666179.988350:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788666179.988452:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab290579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186198400:0@lo:400:kworker.0 00000100:00100000:3.0:1788666179.988829:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab290579f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186198144:0@lo:400:kworker.0 00000100:00100000:2.0:1788666180.490930:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788666180.490953:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186198912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788666180.491037:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666180.491337:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186198912 00000100:00100000:1.0:1788666180.491345:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186198912 00000100:00100000:1.0:1788666180.491409:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788666180.491420:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186198912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788666180.491456:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666180.491512:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186198912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666180.491519:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1788666180.491703:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bfa61f80 x1875552186198912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666180.491722:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186198912:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788666180.619768:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666181.527667:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab290579f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186199040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788666181.527783:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666181.528288:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186199040 00000100:00100000:1.0:1788666181.528300:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186199040 00000100:00100000:3.0:1788666181.528486:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788666181.528507:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186199040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788666181.528564:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666181.528705:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186199040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 207us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666181.528713:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788666181.528826:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab290579f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186199040:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788666181.528995:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788666181.643313:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666182.666875:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666183.693820:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666183.693886:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666183.693938:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666183.693974:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666183.694002:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173580416 00000100:00100000:1.0:1788666183.694015:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173580416 00000100:00100000:1.0:1788666183.694100:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173580672 00000100:00100000:1.0:1788666183.694104:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173580672 00000100:00100000:1.0:1788666183.694136:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 114 00000100:00100000:1.0:1788666183.694149:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29057b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+5:2362:x1875552173580416:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666183.694257:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29057b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+5:2362:x1875552173580416:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 110us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666183.694267:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 114 00000100:00100000:1.0:1788666183.694289:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 115 00000100:00100000:1.0:1788666183.694296:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29057a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84416489-fb20-4430-94f5-31470edbb54e+5:2362:x1875552173580672:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666183.694321:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29057a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84416489-fb20-4430-94f5-31470edbb54e+5:2362:x1875552173580672:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 26us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666183.694327:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 115 00000100:00080000:1.0:1788666183.694351:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666183.695184:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173580288 00000100:00100000:2.0:1788666183.695196:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173580288 00000100:00100000:2.0:1788666183.695266:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 280 00000100:00100000:2.0:1788666183.695277:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29887b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2362:x1875552173580288:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666183.695333:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29887b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2362:x1875552173580288:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 59us (1532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666183.695340:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 280 00000100:00100000:3.0:1788666183.696814:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173580544 00000100:00100000:3.0:1788666183.696829:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173580544 00000100:00100000:3.0:1788666183.696997:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 67 00000100:00100000:3.0:1788666183.697010:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290579c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+5:2362:x1875552173580544:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666183.697087:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290579c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+5:2362:x1875552173580544:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 82us (3200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666183.697096:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 67 00010000:00010000:0.0:1788666183.697948:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788666183.703610:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788666184.720698:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666185.099554:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186199296:0@lo:400:kworker.0 00000100:00100000:3.0:1788666185.099615:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186199168:0@lo:400:kworker.0 00000100:00100000:0.0:1788666185.101562:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186199424:0@lo:400:kworker.0 00000100:00100000:2.0:1788666185.101602:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab298b97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186199552:0@lo:400:kworker.0 00000100:00100000:1.0:1788666185.101944:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666185.101954:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666185.102256:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab298b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186199680:0@lo:400:kworker.0 00000100:00100000:3.0:1788666185.102320:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666185.102327:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab298b94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186199808:0@lo:400:kworker.0 00000100:00100000:1.0:1788666185.102357:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666185.102379:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186199168 00000100:00100000:3.0:1788666185.102388:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186199168 00000100:00100000:1.0:1788666185.102409:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186199296 00000100:00100000:1.0:1788666185.102427:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186199296 00000100:00100000:1.0:1788666185.102460:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186199680 00000100:00100000:1.0:1788666185.102463:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186199680 00000100:00100000:1.0:1788666185.102494:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788666185.102502:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186199296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666185.102568:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290579f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186199296:12345-0@lo:400:kworker.0 Request processed in 66us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666185.102576:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788666185.102600:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666185.102614:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788666185.102620:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186199680:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788666185.102644:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666185.102659:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186199808 00000100:00100000:2.0:1788666185.102663:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186199808 00000100:00100000:1.0:1788666185.102666:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186199680:12345-0@lo:400:kworker.0 Request processed in 47us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666185.102671:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788666185.102691:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186199552 00000100:00100000:2.0:1788666185.102694:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186199552 00000100:00100000:1.0:1788666185.102694:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788666185.102700:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186199808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666185.102715:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788666185.102722:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186199552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666185.102727:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186199808:12345-0@lo:400:kworker.0 Request processed in 28us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666185.102733:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788666185.102754:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186199552:12345-0@lo:400:kworker.0 Request processed in 33us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666185.102759:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788666185.102784:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186199296:0@lo:400:kworker.0 00010000:00080000:1.0:1788666185.102798:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab298b94000 x1875552186199808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666185.102808:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab298b94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186199808:0@lo:400:kworker.0 00000100:00100000:1.0:1788666185.102838:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab298b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186199680:0@lo:400:kworker.0 00000100:00100000:3.0:1788666185.102954:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788666185.102963:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186199168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666185.103000:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186199168:12345-0@lo:400:kworker.0 Request processed in 39us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666185.103006:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00080000:3.0:1788666185.103040:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788666185.103051:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788666185.103077:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab298b97b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186199552:0@lo:400:kworker.0 00000100:00100000:1.0:1788666185.103077:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186199168:0@lo:400:kworker.0 00000100:00100000:0.0:1788666185.107193:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666185.107509:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186199424 00000100:00100000:2.0:1788666185.107519:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186199424 00000100:00100000:2.0:1788666185.107624:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788666185.107636:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186199424:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788666185.108200:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666185.109221:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186199424:0@lo:400:kworker.0 00000100:00100000:2.0:1788666185.109306:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186199424:12345-0@lo:400:kworker.0 Request processed in 1670us (2653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666185.109336:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788666185.611259:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788666185.611287:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186199936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788666185.612142:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666185.612211:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186199936 00000100:00100000:1.0:1788666185.612220:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186199936 00000100:00100000:1.0:1788666185.612275:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788666185.612286:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186199936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788666185.612330:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666185.612389:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186199936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666185.612396:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1788666185.612703:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2bfa61c00 x1875552186199936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666185.612725:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186199936:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788666185.742205:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666186.639150:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788666186.639181:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186200064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788666186.639279:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666186.639492:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186200064 00000100:00100000:1.0:1788666186.639501:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186200064 00000100:00100000:1.0:1788666186.639669:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788666186.639680:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186200064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788666186.639721:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666186.639847:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186200064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 168us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666186.639856:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788666186.639939:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186200064:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788666186.764601:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788666186.827355:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788666187.788790:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666188.804386:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666188.804463:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666188.805147:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173580928 00000100:00100000:3.0:1788666188.805165:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173580928 00000100:00100000:3.0:1788666188.805290:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 119 00000100:00100000:3.0:1788666188.805315:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+5:2362:x1875552173580928:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666188.805466:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+5:2362:x1875552173580928:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 162us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666188.805467:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173580800 00000100:00100000:2.0:1788666188.805474:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173580800 00000100:00100000:3.0:1788666188.805487:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 119 00000100:00080000:1.0:1788666188.805502:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666188.805530:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 282 00000100:00100000:2.0:1788666188.805541:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2362:x1875552173580800:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666188.805618:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2362:x1875552173580800:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 41us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666188.805626:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 282 00010000:00010000:1.0:1788666188.810753:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666188.823425:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666188.823552:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666188.826649:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173581056 00000100:00100000:2.0:1788666188.826689:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173581056 00000100:00100000:2.0:1788666188.826846:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:2.0:1788666188.826861:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+5:2357:x1875552173581056:12345-192.168.201.25@tcp:9:kworker.0 00000020:00000080:2.0:1788666188.826905:0:8429:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e9b5a 00000100:00080000:2.0:1788666188.826915:0:8429:0:(import.c:65:import_set_state_nolock()) ffff8ab2c1f2b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788666188.826964:0:8429:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:0.0:1788666188.827111:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666188.827378:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+2:2357:x1875552173581056:12345-192.168.201.25@tcp:9:kworker.0 Request processed in 519us (3822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666188.827387:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:1.0:1788666188.829222:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173581184 00000100:00100000:1.0:1788666188.829248:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173581184 00000100:00100000:1.0:1788666188.829372:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 120 00000100:00100000:1.0:1788666188.829386:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84416489-fb20-4430-94f5-31470edbb54e+5:2362:x1875552173581184:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666188.829513:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84416489-fb20-4430-94f5-31470edbb54e+5:2362:x1875552173581184:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 131us (6105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666188.829547:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 120 00000100:00080000:3.0:1788666188.830445:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788666188.830456:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788666189.835035:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666190.219921:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186200320:0@lo:400:kworker.0 00000100:00100000:2.0:1788666190.220017:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666190.220099:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b422b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186200832:0@lo:400:kworker.0 00000100:00100000:2.0:1788666190.220149:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666190.220188:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788666190.220194:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186200192:0@lo:400:kworker.0 00000100:00100000:2.0:1788666190.220229:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666190.220274:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186200704:0@lo:400:kworker.0 00000100:00100000:2.0:1788666190.220298:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666190.220864:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186200320 00000100:00100000:0.0:1788666190.220873:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186200320 00000100:00100000:0.0:1788666190.220939:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186200704 00000100:00100000:0.0:1788666190.220943:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186200704 00000100:00100000:0.0:1788666190.220978:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788666190.220989:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186200320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666190.221055:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186200320:12345-0@lo:400:kworker.0 Request processed in 69us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666190.221064:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788666190.221082:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788666190.221088:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186200704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666190.221128:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186200704:12345-0@lo:400:kworker.0 Request processed in 41us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666190.221142:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788666190.221491:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186200448:0@lo:400:kworker.0 00000100:00100000:3.0:1788666190.221536:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666190.221570:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788666190.221576:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186200576:0@lo:400:kworker.0 00000100:00100000:3.0:1788666190.221650:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666190.221689:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186200832 00000100:00100000:3.0:1788666190.221707:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186200832 00000100:00100000:3.0:1788666190.221744:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186200576 00000100:00100000:3.0:1788666190.221747:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186200576 00000100:00100000:3.0:1788666190.221766:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788666190.221780:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186200832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666190.221820:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186200832:12345-0@lo:400:kworker.0 Request processed in 47us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666190.221825:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788666190.221838:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788666190.221844:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae27b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186200576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666190.221875:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae27b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186200576:12345-0@lo:400:kworker.0 Request processed in 32us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666190.221881:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1788666190.221906:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788666190.221911:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788666190.221914:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666190.221978:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186200576:0@lo:400:kworker.0 00000100:00100000:3.0:1788666190.221998:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186200448 00000100:00100000:3.0:1788666190.222001:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186200448 00000100:00100000:3.0:1788666190.222025:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788666190.222031:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186200448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666190.222065:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186200448:12345-0@lo:400:kworker.0 Request processed in 34us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666190.222070:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:3.0:1788666190.222082:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666190.222097:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186200448:0@lo:400:kworker.0 00000100:00100000:2.0:1788666190.223216:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186200704:0@lo:400:kworker.0 00000100:00100000:2.0:1788666190.223233:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186200320:0@lo:400:kworker.0 00010000:00080000:2.0:1788666190.223253:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2b422b480 x1875552186200832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666190.223264:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b422b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186200832:0@lo:400:kworker.0 00000100:00100000:1.0:1788666190.223717:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186200192 00000100:00100000:1.0:1788666190.223731:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186200192 00000100:00100000:1.0:1788666190.223810:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788666190.223821:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186200192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666190.223921:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186200192:12345-0@lo:400:kworker.0 Request processed in 102us (3691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666190.223938:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788666190.224570:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186200192:0@lo:400:kworker.0 00000100:00100000:1.0:1788666190.731246:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788666190.731286:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186200960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788666190.731722:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666190.732614:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186200960 00000100:00100000:2.0:1788666190.732627:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186200960 00000100:00100000:2.0:1788666190.732703:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788666190.732716:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186200960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788666190.732767:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666190.732883:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186200960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 170us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666190.732892:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1788666190.735223:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2ae278380 x1875552186200960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666206 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666190.735279:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae278380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186200960:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788666190.860905:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666191.758123:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788666191.758152:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186201088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788666191.758255:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666191.758550:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186201088 00000100:00100000:2.0:1788666191.758561:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186201088 00000100:00100000:2.0:1788666191.758666:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788666191.758678:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b422a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186201088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788666191.758732:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666191.758799:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b422a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186201088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666191.758808:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788666191.758962:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186201088:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788666191.882832:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666192.907093:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788666193.432343:0:6678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0911d461-5865-4ef7-8c3e-012fc04add58 00000020:00000080:2.0:1788666193.432361:0:6678:0:(genops.c:885:class_export_put()) final put ffff8ab28638a800/0911d461-5865-4ef7-8c3e-012fc04add58 00000020:00000080:1.0:1788666193.432529:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab28638a800/0911d461-5865-4ef7-8c3e-012fc04add58 for lustre-OST0000 00000020:00000080:1.0:1788666193.432616:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab2c1f2b000 for lustre-OST0000 00000100:00100000:3.0:1788666193.923352:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666193.923422:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666193.923571:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173581312 00000100:00100000:2.0:1788666193.923635:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173581312 00000100:00100000:2.0:1788666193.923710:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 284 00000100:00100000:2.0:1788666193.923724:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2362:x1875552173581312:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666193.923834:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2362:x1875552173581312:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 114us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666193.923843:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 284 00000100:00100000:3.0:1788666193.925316:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00010000:00010000:3.0:1788666193.931571:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666193.932930:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173581440 00000100:00100000:0.0:1788666193.932975:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173581440 00000100:00080000:3.0:1788666193.933161:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666193.934433:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173581568 00000100:00100000:0.0:1788666193.934452:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173581568 00000100:00100000:2.0:1788666193.934633:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 124 00000100:00100000:2.0:1788666193.934652:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+5:2362:x1875552173581440:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666193.934799:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+5:2362:x1875552173581440:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 154us (11375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666193.934810:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 124 00000100:00100000:2.0:1788666193.934832:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 125 00000100:00100000:2.0:1788666193.934840:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84416489-fb20-4430-94f5-31470edbb54e+5:2362:x1875552173581568:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666193.934870:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84416489-fb20-4430-94f5-31470edbb54e+5:2362:x1875552173581568:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 31us (9561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666193.934876:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 125 00000100:00080000:3.0:1788666193.936268:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788666194.955537:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666195.341075:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788666195.341101:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186201216:0@lo:400:kworker.0 00000100:00100000:2.0:1788666195.341267:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666195.341352:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186201216 00000100:00100000:2.0:1788666195.341360:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186201216 00000100:00100000:2.0:1788666195.341421:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788666195.341448:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186201216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666195.341510:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186201216:12345-0@lo:400:kworker.0 Request processed in 64us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666195.341518:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1788666195.341597:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186201216:0@lo:400:kworker.0 00000100:00100000:3.0:1788666195.341968:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186201600:0@lo:400:kworker.0 00000100:00100000:0.0:1788666195.342985:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186201728:0@lo:400:kworker.0 00000100:00100000:0.0:1788666195.343050:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666195.343099:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788666195.343106:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186201344:0@lo:400:kworker.0 00000100:00100000:0.0:1788666195.343127:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666195.343145:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186201856:0@lo:400:kworker.0 00000100:00100000:0.0:1788666195.343212:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666195.343254:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae27aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186201472:0@lo:400:kworker.0 00000100:00100000:0.0:1788666195.343281:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666195.343324:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186201728 00000100:00100000:0.0:1788666195.343332:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186201728 00000100:00100000:0.0:1788666195.343403:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186201344 00000100:00100000:0.0:1788666195.343406:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186201344 00000100:00100000:0.0:1788666195.343421:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186201472 00000100:00100000:0.0:1788666195.343423:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186201472 00000100:00100000:0.0:1788666195.343440:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788666195.343447:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b422b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186201728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666195.343500:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b422b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186201728:12345-0@lo:400:kworker.0 Request processed in 52us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666195.343508:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788666195.343523:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788666195.343529:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186201344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666195.343551:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186201344:12345-0@lo:400:kworker.0 Request processed in 23us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666195.343568:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788666195.343602:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788666195.343609:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186201472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666195.343642:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186201472:12345-0@lo:400:kworker.0 Request processed in 35us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666195.343648:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788666195.343685:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186201856 00000100:00100000:0.0:1788666195.343689:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186201856 00000100:00100000:0.0:1788666195.343722:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788666195.343728:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186201856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666195.343758:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186201856:12345-0@lo:400:kworker.0 Request processed in 30us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666195.343764:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1788666195.343784:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788666195.343789:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666195.344253:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666195.344298:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186201600 00000100:00100000:3.0:1788666195.344304:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186201600 00000100:00100000:3.0:1788666195.344335:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788666195.344343:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186201600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666195.344391:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186201600:12345-0@lo:400:kworker.0 Request processed in 50us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666195.344398:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788666195.344425:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186201600:0@lo:400:kworker.0 00000100:00100000:0.0:1788666195.348040:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186201344:0@lo:400:kworker.0 00010000:00080000:0.0:1788666195.348102:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2b46b4000 x1875552186201856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666195.348117:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186201856:0@lo:400:kworker.0 00000100:00100000:0.0:1788666195.348131:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186201728:0@lo:400:kworker.0 00000100:00100000:0.0:1788666195.348322:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae27aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186201472:0@lo:400:kworker.0 00000100:00080000:0.0:1788666195.348350:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788666195.855199:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788666195.855244:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab298b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186201984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788666195.855348:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666195.855526:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186201984 00000100:00100000:0.0:1788666195.855535:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186201984 00000100:00100000:0.0:1788666195.859181:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788666195.859209:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186201984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788666195.859253:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666195.859352:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186201984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (4004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666195.859370:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1788666195.859434:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab298b91c00 x1875552186201984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666211 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666195.859455:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab298b91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186201984:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788666195.988226:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788666196.043514:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788666196.879686:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186202112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788666196.879830:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666196.880145:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186202112 00000100:00100000:0.0:1788666196.880178:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186202112 00000100:00100000:0.0:1788666196.880423:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788666196.880437:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186202112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788666196.880493:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666196.880560:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186202112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666196.880567:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788666196.880704:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186202112:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788666197.005437:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666198.028515:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666199.052031:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666199.052098:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666199.052128:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666199.052175:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173581824 00000100:00100000:2.0:1788666199.052190:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173581824 00000100:00100000:3.0:1788666199.052393:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173581696 00000100:00100000:3.0:1788666199.052398:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173581696 00000100:00100000:3.0:1788666199.052475:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 286 00000100:00100000:3.0:1788666199.052489:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2361:x1875552173581696:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666199.052618:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2361:x1875552173581696:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 132us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666199.052639:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 286 00000100:00100000:1.0:1788666199.053415:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173581952 00000100:00100000:1.0:1788666199.053426:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173581952 00000100:00100000:2.0:1788666199.053485:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 129 00000100:00100000:2.0:1788666199.053495:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+5:2361:x1875552173581824:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666199.053563:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+5:2361:x1875552173581824:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 70us (1549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666199.053570:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 129 00000100:00080000:3.0:1788666199.063548:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788666199.064687:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 130 00000100:00100000:1.0:1788666199.064705:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84416489-fb20-4430-94f5-31470edbb54e+5:2361:x1875552173581952:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666199.064840:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84416489-fb20-4430-94f5-31470edbb54e+5:2361:x1875552173581952:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 141us (12710us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666199.064849:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 130 00010000:00010000:1.0:1788666199.065149:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788666199.724458:0:11814:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 23:43:17 (1788666197) 00010000:00010000:2.0:1788666200.082502:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666200.458923:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186202624:0@lo:400:kworker.0 00000100:00100000:3.0:1788666200.459034:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666200.459124:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788666200.459131:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae27aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186202496:0@lo:400:kworker.0 00000100:00100000:3.0:1788666200.459160:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666200.459215:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186202624 00000100:00100000:3.0:1788666200.459223:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186202624 00000100:00100000:3.0:1788666200.459295:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788666200.459307:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186202624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666200.459365:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186202240:0@lo:400:kworker.0 00000100:00100000:3.0:1788666200.459366:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186202624:12345-0@lo:400:kworker.0 Request processed in 63us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666200.459375:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788666200.459415:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666200.459455:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186202752:0@lo:400:kworker.0 00000100:00100000:0.0:1788666200.459492:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666200.459508:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186202368:0@lo:400:kworker.0 00000100:00100000:0.0:1788666200.459525:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186202240 00000100:00100000:0.0:1788666200.459529:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186202240 00000100:00100000:2.0:1788666200.459540:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666200.459626:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186202496 00000100:00100000:1.0:1788666200.459631:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186202496 00000100:00100000:1.0:1788666200.459662:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186202752 00000100:00100000:1.0:1788666200.459665:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186202752 00000100:00100000:1.0:1788666200.459680:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186202368 00000100:00100000:1.0:1788666200.459682:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186202368 00000100:00100000:1.0:1788666200.459695:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788666200.459703:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186202496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666200.459739:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae509f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186202496:12345-0@lo:400:kworker.0 Request processed in 37us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666200.459746:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788666200.459760:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788666200.459765:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186202752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666200.459803:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186202752:12345-0@lo:400:kworker.0 Request processed in 37us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666200.459809:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1788666200.459820:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788666200.459825:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186202368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666200.459851:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186202368:12345-0@lo:400:kworker.0 Request processed in 26us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666200.459856:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788666200.459899:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae278a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186202752:0@lo:400:kworker.0 00000100:00100000:2.0:1788666200.459987:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186202880:0@lo:400:kworker.0 00000100:00100000:2.0:1788666200.460015:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666200.460046:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186202368:0@lo:400:kworker.0 00000100:00100000:2.0:1788666200.460075:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186202880 00000100:00100000:2.0:1788666200.460078:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186202880 00000100:00100000:2.0:1788666200.460107:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788666200.460113:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186202880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666200.460161:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186202880:12345-0@lo:400:kworker.0 Request processed in 48us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666200.460167:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:2.0:1788666200.460193:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2988fd500 x1875552186202880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788666216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666200.460204:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186202880:0@lo:400:kworker.0 00000100:00100000:0.0:1788666200.464159:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788666200.464199:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186202240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666200.464389:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186202240:12345-0@lo:400:kworker.0 Request processed in 211us (4972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666200.464399:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:0.0:1788666200.464540:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788666200.464551:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788666200.464554:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788666200.464738:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae27aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186202496:0@lo:400:kworker.0 00000100:00100000:0.0:1788666200.464759:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae279c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186202624:0@lo:400:kworker.0 00000100:00100000:1.0:1788666200.466746:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186202240:0@lo:400:kworker.0 00000100:00100000:1.0:1788666200.971785:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab298b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186203008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788666200.971909:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666200.972941:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186203008 00000100:00100000:2.0:1788666200.972963:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186203008 00000100:00100000:2.0:1788666200.973059:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788666200.973073:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186203008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788666200.973146:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666200.983322:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186203008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 10199us (11360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666200.983349:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1788666200.988483:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab298b90e00 x1875552186203008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666216 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666200.988546:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab298b90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186203008:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788666201.099921:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666201.995840:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186203136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788666201.995960:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666202.000179:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186203136 00000100:00100000:1.0:1788666202.000205:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186203136 00000100:00100000:1.0:1788666202.000366:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788666202.000381:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186203136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788666202.000457:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666202.000617:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae50a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186203136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 238us (4656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666202.000625:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:0.0:1788666202.000875:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788666202.003813:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186203136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788666202.112127:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666202.112328:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173582080 00000100:00100000:1.0:1788666202.112343:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173582080 00000100:00100000:1.0:1788666202.112755:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:1.0:1788666202.112768:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+5:10253:x1875552173582080:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788666202.112794:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666202.112820:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361e9c25 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d428bb expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.112895:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361e9c2c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.112914:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361e9c2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.112930:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361e9c2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666202.112975:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788666202.112995:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788666202.113059:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361e9c2c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.113084:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361e9c25 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428bb expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.113105:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361e9c2c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428bb expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.113114:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2908f2a00) 00010000:00010000:1.0:1788666202.113118:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788666202.113121:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298854600, rc 0) 00000100:00100000:1.0:1788666202.113212:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae509500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:10253:x1875552173582080:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 447us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666202.113225:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 32 00010000:00010000:3.0:1788666202.124964:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788666202.125102:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788666202.128615:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666202.128842:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173582208 00000100:00100000:2.0:1788666202.128859:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173582208 00000100:00100000:2.0:1788666202.128923:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:2.0:1788666202.128933:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+6:10254:x1875552173582208:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788666202.128956:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666202.128980:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9c33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d428c2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129057:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9c3a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129072:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9c3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129101:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9c3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129118:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9c41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129126:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9c41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129132:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9c41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129407:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3400/0x96bbe788361e9c48 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129416:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3400/0x96bbe788361e9c48 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129423:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3400/0x96bbe788361e9c48 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666202.129454:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788666202.129457:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788666202.129480:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3400/0x96bbe788361e9c48 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129490:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9c3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129497:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9c3a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129513:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9c3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129519:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666202.129524:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9c3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129532:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9c3a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129545:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2908f2a00) 00010000:00010000:2.0:1788666202.129549:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666202.129553:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9c3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129561:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9c3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129574:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9c41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129637:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9c41 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129643:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9c41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129648:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666202.129651:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9c41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129666:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9c41 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129675:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8ab2a088ef00) 00010000:00010000:2.0:1788666202.129677:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666202.129680:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9c41 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129686:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9c41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129723:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9c33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428c2 expref: 8 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129736:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3400/0x96bbe788361e9c48 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428c2 expref: 7 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666202.129742:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ab2a088ea00) 00010000:00010000:2.0:1788666202.129745:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788666202.129747:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f3400, rc 0) 00000100:00100000:2.0:1788666202.129817:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+7:10254:x1875552173582208:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 884us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666202.129824:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:3.0:1788666202.135152:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666202.135471:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173582464 00000100:00100000:1.0:1788666202.135490:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173582464 00000100:00100000:1.0:1788666202.135575:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 34 00000100:00100000:1.0:1788666202.135613:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+7:10254:x1875552173582464:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788666202.135643:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666202.135673:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361e9c4f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d428c9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.135770:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361e9c56 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.135788:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361e9c56 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.135839:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361e9c56 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.135879:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9c5d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.135889:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9c5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.135895:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9c5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.136378:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854000/0x96bbe788361e9c64 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.136388:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854000/0x96bbe788361e9c64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.136395:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854000/0x96bbe788361e9c64 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666202.136409:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788666202.136617:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361e9c56 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.136626:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361e9c56 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.136634:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361e9c56 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.136641:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666202.136655:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361e9c56 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.136664:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361e9c56 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.136678:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ab2a088ea00) 00010000:00010000:1.0:1788666202.136681:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666202.136686:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361e9c56 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.136693:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361e9c56 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.136709:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9c5d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.136715:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9c5d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.136720:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9c5d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.136726:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298854200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666202.136729:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9c5d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.136734:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9c5d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.136741:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ab2908f2800) 00010000:00010000:1.0:1788666202.136743:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666202.136752:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9c5d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.136758:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9c5d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.137301:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361e9c4f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428c9 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.137323:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854000/0x96bbe788361e9c64 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428c9 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666202.137332:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab2908f2b00) 00010000:00010000:1.0:1788666202.137335:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666202.137337:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298854000, rc 0) 00000100:00100000:1.0:1788666202.137441:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae50a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+9:10254:x1875552173582464:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 1840us (2312us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788666202.137450:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 34 00000100:00100000:0.0:1788666202.150112:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666202.150231:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173582592 00000100:00100000:2.0:1788666202.150246:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173582592 00000100:00100000:2.0:1788666202.150335:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00100000:2.0:1788666202.150348:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+9:10254:x1875552173582592:12345-192.168.201.25@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788666202.150536:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+9:10254:x1875552173582592:12345-192.168.201.25@tcp:59:lhsmtool_posix.0 Request processed in 190us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666202.150544:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 35 00000040:00080000:2.0:1788666202.189024:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788666203.147791:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788666203.602345:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00000100:00100000:0.0:1788666204.165460:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666204.165526:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666204.165549:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666204.165621:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173582976 00000100:00100000:3.0:1788666204.165631:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173582976 00000100:00100000:3.0:1788666204.165690:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173582848 00000100:00100000:3.0:1788666204.165692:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173582848 00000100:00100000:3.0:1788666204.165709:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 134 00000100:00100000:3.0:1788666204.165718:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84416489-fb20-4430-94f5-31470edbb54e+5:2361:x1875552173582976:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666204.165798:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84416489-fb20-4430-94f5-31470edbb54e+5:2361:x1875552173582976:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 82us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666204.165814:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 134 00000100:00100000:3.0:1788666204.165828:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 135 00000100:00100000:3.0:1788666204.165833:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+8:2361:x1875552173582848:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666204.165851:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+8:2361:x1875552173582848:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 18us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666204.165855:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 135 00000100:00080000:0.0:1788666204.166065:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666204.166505:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173582720 00000100:00100000:2.0:1788666204.166512:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173582720 00000100:00100000:2.0:1788666204.166610:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 288 00000100:00100000:2.0:1788666204.166619:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2361:x1875552173582720:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666204.166666:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2361:x1875552173582720:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 49us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666204.166674:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 288 00010000:00010000:2.0:1788666204.171060:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666204.646698:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666204.646779:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173583104 00000100:00100000:2.0:1788666204.646794:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173583104 00000100:00100000:2.0:1788666204.646884:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:2.0:1788666204.646896:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+8:10297:x1875552173583104:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666204.646925:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666204.646953:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9c72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d428d0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647044:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361e9c79 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647062:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361e9c79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647078:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361e9c79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647125:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9c80 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647134:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9c80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647141:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9c80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647688:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361e9c79 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647715:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361e9c79 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647723:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361e9c79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647730:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2a00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666204.647736:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361e9c79 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647746:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361e9c79 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647761:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2908f2a00) 00010000:00010000:2.0:1788666204.647765:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666204.647770:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361e9c79 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647778:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361e9c79 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647803:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9c80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647810:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9c80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647816:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9c80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647821:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666204.647824:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9c80 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647830:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9c80 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647838:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ab2a088e000) 00010000:00010000:2.0:1788666204.647841:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666204.647844:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9c80 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647850:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9c80 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647895:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9c72 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428d0 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647907:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2908f2a00) 00010000:00010000:2.0:1788666204.647910:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666204.647919:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9c72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428d0 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.647930:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2e00, rc 0) 00000100:00100000:2.0:1788666204.648021:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+8:10297:x1875552173583104:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1127us (1334us total) trans 0 rc 301/301 00000100:00100000:2.0:1788666204.648030:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:3.0:1788666204.661298:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666204.661445:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173583360 00000100:00100000:1.0:1788666204.661460:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173583360 00000100:00100000:1.0:1788666204.661540:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00100000:1.0:1788666204.661554:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+8:10297:x1875552173583360:12345-192.168.201.25@tcp:36:lfs.0 00010000:00010000:1.0:1788666204.661667:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666204.661710:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361e9c2c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428bb expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666204.661740:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2908f2a00) 00010000:00010000:1.0:1788666204.661755:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788666204.662057:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361e9c87 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666204.662075:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361e9c87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666204.662086:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361e9c87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666204.662111:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9c8e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666204.662118:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9c8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666204.662125:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9c8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666204.666492:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788666204.666523:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361e9c87 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666204.666536:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361e9c87 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666204.666545:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361e9c87 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666204.666553:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855e00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666204.666571:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361e9c87 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666204.666617:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361e9c87 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666204.666644:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2908f2200) 00010000:00010000:1.0:1788666204.666647:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666204.666654:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361e9c87 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666204.666660:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361e9c87 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788666204.666686:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ff4bf38 reply state 000000000bf5d900 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9c8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666204.666696:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788666204.666849:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae509180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+9:10297:x1875552173583360:12345-192.168.201.25@tcp:36:lfs.0 Request processed in 5292us (5561us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788666204.666860:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 37 00010000:00010000:3.0:1788666204.671679:0:3261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9c8e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.671708:0:3261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9c8e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.671718:0:3261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9c8e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.671727:0:3261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298854200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666204.671735:0:3261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9c8e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.671745:0:3261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9c8e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.671767:0:3261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ab2908f2500) 00010000:00010000:3.0:1788666204.671771:0:3261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666204.671777:0:3261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9c8e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.671784:0:3261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361e9c8e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666204.793159:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666204.793293:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173583488 00000100:00100000:2.0:1788666204.793309:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173583488 00000100:00100000:2.0:1788666204.793395:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:2.0:1788666204.793407:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+8:10305:x1875552173583488:12345-192.168.201.25@tcp:101:lctl.0 00010000:00010000:2.0:1788666204.793441:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666204.793473:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9c95 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d428d7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.793563:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361e9c9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.793616:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361e9c9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.793633:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361e9c9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666204.793682:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788666204.793687:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788666204.793738:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361e9c9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.793768:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9c95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428d7 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.793809:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361e9c9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428d7 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.793818:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2a088e000) 00010000:00010000:2.0:1788666204.793822:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788666204.793827:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2a00, rc 0) 00000100:00100000:2.0:1788666204.793924:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae50ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+9:10305:x1875552173583488:12345-192.168.201.25@tcp:101:lctl.0 Request processed in 520us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666204.793933:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:2.0:1788666204.856248:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666204.856357:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173583616 00000100:00100000:3.0:1788666204.856368:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173583616 00000100:00100000:3.0:1788666204.856646:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:3.0:1788666204.856657:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+9:10311:x1875552173583616:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1788666204.856681:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666204.856702:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9ca3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d428de expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.856769:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9caa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.856785:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9caa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.856798:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9caa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.856814:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9cb1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.856822:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.856828:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.856941:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe200/0x96bbe788361e9cb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.856970:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe200/0x96bbe788361e9cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.856978:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe200/0x96bbe788361e9cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666204.857009:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788666204.857013:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788666204.857055:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe200/0x96bbe788361e9cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.857069:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9caa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.857075:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9caa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.857082:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9caa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.857089:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666204.857093:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9caa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.857102:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9caa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.857117:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2a088e000) 00010000:00010000:3.0:1788666204.857120:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666204.857124:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9caa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.857141:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9caa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.857158:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9cb1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.857163:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9cb1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.857169:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.857174:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666204.857177:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9cb1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.857184:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9cb1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.857192:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8ab2b9e72f00) 00010000:00010000:3.0:1788666204.857195:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666204.857197:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9cb1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.857213:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9cb1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.857246:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9ca3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428de expref: 11 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.857260:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe200/0x96bbe788361e9cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428de expref: 10 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.857274:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:3.0:1788666204.857277:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788666204.857279:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814fe200, rc 0) 00000100:00100000:3.0:1788666204.857360:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+10:10311:x1875552173583616:12345-192.168.201.25@tcp:101:bash.0 Request processed in 704us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666204.857369:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:2.0:1788666204.860966:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666204.861066:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173583872 00000100:00100000:3.0:1788666204.861078:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173583872 00000100:00100000:3.0:1788666204.861257:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:3.0:1788666204.861269:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+10:10311:x1875552173583872:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1788666204.861295:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666204.861317:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9cbf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d428e5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.861453:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9cc6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.861468:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9cc6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.861481:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9cc6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.861539:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9ccd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.861547:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9ccd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.861574:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9ccd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788666204.862876:0:5808:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788666204.863078:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9cd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.863177:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.863192:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.863246:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9cc6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.863254:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9cc6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.863261:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9cc6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.863266:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff000 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666204.863272:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9cc6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.863281:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9cc6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.863294:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:3.0:1788666204.863297:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666204.863312:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9cc6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.863319:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9cc6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788666204.863334:0:5808:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d0581c42 reply state 000000001eed7266 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9ccd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666204.863343:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788666204.863387:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9cbf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428e5 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.863401:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9cd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428e5 expref: 12 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.863409:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72f00) 00010000:00010000:3.0:1788666204.863411:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788666204.863414:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814fe400, rc 0) 00000100:00100000:3.0:1788666204.863553:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+13:10311:x1875552173583872:12345-192.168.201.25@tcp:101:bash.0 Request processed in 2286us (2601us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788666204.863563:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 40 00010000:00010000:1.0:1788666204.865873:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9ccd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666204.865898:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9ccd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666204.865907:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9ccd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666204.865912:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814fe600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666204.865916:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9ccd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666204.865921:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9ccd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666204.865955:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab2b9e72b00) 00010000:00010000:1.0:1788666204.865957:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666204.865961:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9ccd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666204.865966:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9ccd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666204.872083:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666204.873003:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173584000 00000100:00100000:3.0:1788666204.873019:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173584000 00000100:00100000:3.0:1788666204.873078:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:3.0:1788666204.873086:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1875552173584000:12345-192.168.201.25@tcp:8:bash.0 00010000:00080000:3.0:1788666204.873257:0:6651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp t0 exp 0000000000000000 cur 311 last 0 00000020:00000080:3.0:1788666204.873298:0:6651:0:(genops.c:1385:class_connect()) connect: client 0911d461-5865-4ef7-8c3e-012fc04add58, cookie 0x96bbe788361e9ce2 00002000:00100000:3.0:1788666204.873312:0:6651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0911d461-5865-4ef7-8c3e-012fc04add58/ffff8ab298ba7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788666204.873357:0:6651:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788666204.873721:0:6651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788666204.873761:0:6651:0:(import.c:65:import_set_state_nolock()) ffff8ab298ba0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788666204.873907:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2357:x1875552173584000:12345-192.168.201.25@tcp:8:bash.0 Request processed in 819us (1835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666204.873918:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:0.0:1788666204.876802:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666204.876900:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173584128 00000100:00100000:2.0:1788666204.876912:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173584128 00000100:00100000:2.0:1788666204.877035:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:2.0:1788666204.877049:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:0:x1875552173584128:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:2.0:1788666204.877071:0:6649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666204.877110:0:6649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008420a788/0x96bbe788361e9ce9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d428ec expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788666204.877142:0:6649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666204.877165:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=311s v=(0 0) 00010000:00010000:2.0:1788666204.877171:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666204.877183:0:6649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008420a788/0x96bbe788361e9ce9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428ec expref: 7 pid: 6649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.877236:0:6649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008420a788/0x96bbe788361e9ce9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428ec expref: 7 pid: 6649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.877250:0:6649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2c00, rc 0) 00000100:00100000:2.0:1788666204.877324:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+7:0:x1875552173584128:12345-192.168.201.25@tcp:101:bash.0 Request processed in 278us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666204.877331:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:2.0:1788666204.880084:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00080000:0.0:1788666204.880418:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788666204.880468:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173584256 00000100:00100000:3.0:1788666204.880479:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173584256 00000100:00100000:3.0:1788666204.880620:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:3.0:1788666204.880632:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+7:10311:x1875552173584256:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1788666204.880652:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666204.880679:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000930a282b/0x96bbe788361e9cf0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d428f3 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.880717:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008420a788/0x96bbe788361e9ce9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428ec expref: 8 pid: 6649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.880727:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666204.880731:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666204.880737:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000930a282b/0x96bbe788361e9cf0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428f3 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.880775:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008420a788/0x96bbe788361e9ce9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428ec expref: 8 pid: 6649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.880791:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008420a788/0x96bbe788361e9ce9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428ec expref: 8 pid: 6649 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666204.880821:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae50b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8429:1875552186203264:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788666204.880924:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab183862180 going to sleep for 11 seconds 00000100:00100000:1.0:1788666204.883915:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666204.884027:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173584384 00000100:00100000:2.0:1788666204.884037:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173584384 00010000:00010000:2.0:1788666204.884082:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008420a788/0x96bbe788361e9ce9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428ec expref: 9 pid: 6649 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666204.884138:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00100000:2.0:1788666204.884150:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae279c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+9:2363:x1875552173584384:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788666204.884167:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666204.884193:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008420a788/0x96bbe788361e9ce9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428ec expref: 9 pid: 6649 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.884219:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008420a788/0x96bbe788361e9ce9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428ec expref: 9 pid: 6649 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.884249:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666204.884253:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666204.884279:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000930a282b/0x96bbe788361e9cf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428f3 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.884291:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000930a282b/0x96bbe788361e9cf0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428f3 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666204.884334:0:5793:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000930a282b/0x96bbe788361e9cf0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428f3 expref: 9 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666204.884350:0:5793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab298b96a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5793:1875552186203392:192.168.201.25@tcp:105: 00000100:00100000:2.0:1788666204.884434:0:5793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab181ab2180 going to sleep for 11 seconds 00010000:00010000:3.0:1788666204.885678:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008420a788/0x96bbe788361e9ce9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428ec expref: 9 pid: 6649 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666204.885705:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae50b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8429:1875552186203264:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788666204.885736:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000930a282b/0x96bbe788361e9cf0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428f3 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666204.885749:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814ffc00, rc 0) 00000100:00100000:3.0:1788666204.885813:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+8:10311:x1875552173584256:12345-192.168.201.25@tcp:101:bash.0 Request processed in 5183us (5741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666204.885823:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:3.0:1788666204.889694:0:5793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab298b96a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5793:1875552186203392:192.168.201.25@tcp:105: 00010000:00010000:3.0:1788666204.889726:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666204.889781:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae279c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173584384:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 5632us (5882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666204.889793:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00100000:0.0:1788666204.889953:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666204.890323:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173584640 00000100:00100000:3.0:1788666204.890330:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173584640 00000100:00100000:3.0:1788666204.890474:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:3.0:1788666204.890485:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+12:10311:x1875552173584640:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:3.0:1788666204.890927:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+13:10311:x1875552173584640:12345-192.168.201.25@tcp:35:bash.0 Request processed in 443us (973us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788666204.890940:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:0.0:1788666204.982733:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666204.982844:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173584896 00000100:00100000:1.0:1788666204.982857:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173584896 00000100:00100000:1.0:1788666204.982927:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 41 00000100:00100000:1.0:1788666204.982938:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+13:10321:x1875552173584896:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788666204.982963:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666204.982983:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854c00/0x96bbe788361e9cf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d428fa expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666204.983071:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788666204.983231:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854c00/0x96bbe788361e9cf7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428fa expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666204.983251:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2a088e000) 00010000:00010000:1.0:1788666204.983255:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788666204.983261:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854c00/0x96bbe788361e9cf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428fa expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666204.983279:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298854c00, rc 0) 00000100:00100000:1.0:1788666204.983371:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+14:10321:x1875552173584896:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 434us (653us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1788666204.983397:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 41 00000100:00100000:0.0:1788666204.989936:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666204.990055:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173585152 00000100:00100000:2.0:1788666204.990066:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173585152 00000100:00100000:2.0:1788666204.990143:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:2.0:1788666204.990156:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+14:10321:x1875552173585152:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1788666204.990522:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+15:10321:x1875552173585152:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 367us (598us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788666204.990532:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:2.0:1788666205.075135:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666205.075337:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173585280 00000100:00100000:0.0:1788666205.075354:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173585280 00000100:00100000:0.0:1788666205.075485:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:0.0:1788666205.075496:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+15:10327:x1875552173585280:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788666205.075526:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666205.075548:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361e9d05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42901 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666205.075808:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361e9d0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666205.075826:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361e9d0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666205.075841:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361e9d0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666205.075888:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788666205.075893:0:7132:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788666205.075921:0:7132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361e9d0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666205.075952:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361e9d05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42901 expref: 17 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666205.075973:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361e9d0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42901 expref: 16 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666205.076006:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:0.0:1788666205.076009:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788666205.076013:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144b800, rc 0) 00000100:00100000:0.0:1788666205.076212:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+16:10327:x1875552173585280:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 717us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666205.076220:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:0.0:1788666205.081784:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666205.081925:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173585536 00000100:00100000:1.0:1788666205.081943:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173585536 00000100:00100000:1.0:1788666205.082069:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:1.0:1788666205.082082:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+16:10327:x1875552173585536:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788666205.082119:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666205.082155:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854c00/0x96bbe788361e9d13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42908 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.082319:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9d1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.082340:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9d1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.082358:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9d1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666205.082373:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788666205.082642:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854c00/0x96bbe788361e9d13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42908 expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.082670:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9d1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42908 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.082681:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72f00) 00010000:00010000:1.0:1788666205.082685:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788666205.082690:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855a00, rc 0) 00000100:00100000:1.0:1788666205.082800:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+18:10327:x1875552173585536:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 720us (1029us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788666205.082810:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:2.0:1788666205.089004:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666205.089110:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173585792 00000100:00100000:3.0:1788666205.089122:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173585792 00000100:00100000:3.0:1788666205.089207:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:3.0:1788666205.089219:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+18:10327:x1875552173585792:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1788666205.089261:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666205.089294:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9d28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d4290f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.089455:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9d2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.089477:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9d2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.089492:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9d2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666205.089510:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00000100:00100000:0.0:1788666205.092645:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666205.093075:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173585920 00000100:00100000:1.0:1788666205.093099:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173585920 00000100:00100000:1.0:1788666205.093210:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:1.0:1788666205.093221:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+20:2361:x1875552173585920:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666205.093245:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666205.093283:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9d1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42908 expref: 20 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.093309:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72f00) 00010000:00010000:1.0:1788666205.093316:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666205.093508:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+19:2361:x1875552173585920:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 287us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666205.093518:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 2 00010000:00010000:2.0:1788666205.096955:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9d28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4290f expref: 20 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.096991:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9d2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4290f expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.097016:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72f00) 00010000:00010000:2.0:1788666205.097019:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788666205.097023:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814ff800, rc 0) 00000100:00100000:2.0:1788666205.097222:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+19:10327:x1875552173585792:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 8003us (8227us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788666205.097231:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:0.0:1788666205.103822:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666205.103918:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173586048 00000100:00100000:2.0:1788666205.103931:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173586048 00000100:00100000:2.0:1788666205.104027:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:2.0:1788666205.104040:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173586048:12345-192.168.201.25@tcp:1:lfs.0 00010000:00010000:2.0:1788666205.104169:0:6649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c121abe/0x96bbe788361e9d3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.104195:0:6649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000930a282b/0x96bbe788361e9cf0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428f3 expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.104213:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666205.104217:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788666205.104222:0:6649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c121abe/0x96bbe788361e9d3d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.104268:0:6649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000930a282b/0x96bbe788361e9cf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428f3 expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.104287:0:6649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000930a282b/0x96bbe788361e9cf0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428f3 expref: 7 pid: 8429 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666205.104326:0:6649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab298b96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6649:1875552186203520:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788666205.104466:0:6649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab181ab29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788666205.107958:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666205.108076:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173586176 00000100:00100000:1.0:1788666205.108087:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173586176 00002000:00100000:1.0:1788666205.108151:0:6654:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8ab298b92a00 x1875552173586176/t0(0) o4->0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp:246/0 lens 504/0 e 0 to 0 dl 1788666216 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788666205.108164:0:6654:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab298b92a00 with x1875552173586176 ext(0->12) 00010000:00010000:1.0:1788666205.108175:0:6654:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000930a282b/0x96bbe788361e9cf0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428f3 expref: 8 pid: 8429 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.108206:0:6654:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000930a282b/0x96bbe788361e9cf0 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428f3 expref: 8 pid: 8429 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788666205.108235:0:6654:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ab298b92a00 00000100:00100000:1.0:1788666205.108276:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:1.0:1788666205.108287:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0911d461-5865-4ef7-8c3e-012fc04add58+8:2364:x1875552173586176:12345-192.168.201.25@tcp:4:lfs.0 00000100:00100000:2.0:1788666205.109726:0:6649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab298b96a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6649:1875552186203520:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666205.109761:0:6649:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006c121abe/0x96bbe788361e9d3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788666205.137040:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0911d461-5865-4ef7-8c3e-012fc04add58 00000100:00100000:2.0:1788666205.138345:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0911d461-5865-4ef7-8c3e-012fc04add58+9:2364:x1875552173586176:12345-192.168.201.25@tcp:4:lfs.0 Request processed in 30052us (30397us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788666205.138365:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00002000:00100000:2.0:1788666205.138381:0:6654:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8ab298b92a00 x1875552173586176/t4294967299(0) o4->0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp:246/0 lens 504/448 e 0 to 0 dl 1788666216 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788666205.138393:0:6654:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab298b92a00 with x1875552173586176 ext(0->12) 00010000:00010000:2.0:1788666205.138404:0:6654:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000930a282b/0x96bbe788361e9cf0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428f3 expref: 9 pid: 8429 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.138427:0:6654:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000930a282b/0x96bbe788361e9cf0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428f3 expref: 9 pid: 8429 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788666205.138436:0:6654:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ab298b92a00 00000100:00100000:0.0:1788666205.141857:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666205.141958:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173586304 00000100:00100000:3.0:1788666205.141972:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173586304 00010000:00010000:3.0:1788666205.142026:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000930a282b/0x96bbe788361e9cf0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428f3 expref: 9 pid: 8429 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666205.142207:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:3.0:1788666205.142220:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+9:2363:x1875552173586304:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666205.142246:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788666205.142303:0:5793:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788666205.142306:0:5793:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788666205 00002000:00010000:3.0:1788666205.142308:0:5793:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788666205 00002000:00010000:3.0:1788666205.142310:0:5793:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788666205 00010000:00010000:3.0:1788666205.142318:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000930a282b/0x96bbe788361e9cf0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428f3 expref: 9 pid: 8429 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.142334:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000930a282b/0x96bbe788361e9cf0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428f3 expref: 9 pid: 8429 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.142366:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000930a282b/0x96bbe788361e9cf0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428f3 expref: 9 pid: 8429 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.142405:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788666205.142410:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788666205.142416:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006c121abe/0x96bbe788361e9d3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.142426:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c121abe/0x96bbe788361e9d3d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.142461:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666205.142538:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+8:2363:x1875552173586304:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 320us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666205.142556:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 36 00010000:00010000:2.0:1788666205.142842:0:6649:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006c121abe/0x96bbe788361e9d3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.142855:0:6649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c121abe/0x96bbe788361e9d3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.142900:0:6649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c121abe/0x96bbe788361e9d3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.142909:0:6649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c121abe/0x96bbe788361e9d3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.142917:0:6649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c121abe/0x96bbe788361e9d3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.142925:0:6649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2400 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666205.142931:0:6649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c121abe/0x96bbe788361e9d3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.142942:0:6649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c121abe/0x96bbe788361e9d3d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.142956:0:6649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c121abe/0x96bbe788361e9d3d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.142965:0:6649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c121abe/0x96bbe788361e9d3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666205.143041:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173586048:12345-192.168.201.25@tcp:1:lfs.0 Request processed in 39003us (39231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666205.143050:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:0.0:1788666205.147795:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666205.147905:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173586560 00000100:00100000:2.0:1788666205.147918:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173586560 00000100:00100000:2.0:1788666205.148037:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:2.0:1788666205.148050:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+19:10327:x1875552173586560:12345-192.168.201.25@tcp:35:lfs.0 00000004:00010000:2.0:1788666205.148160:0:5812:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9d2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4290f expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788666205.148837:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788666205.148913:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788666205.150300:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788666205.150529:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9d44 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.150976:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9cd4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428e5 expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.150990:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9d44 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.151048:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9cd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428e5 expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.151066:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9cd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428e5 expref: 23 pid: 5808 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666205.151171:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab298b96a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5812:1875552186203648:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788666205.151370:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab181ab29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666205.156281:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab298b96a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5812:1875552186203648:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666205.156317:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9d44 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666205.156458:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666205.156552:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173586688 00000100:00100000:2.0:1788666205.156561:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173586688 00010000:00010000:2.0:1788666205.156635:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9cd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428e5 expref: 24 pid: 5808 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666205.156680:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00100000:2.0:1788666205.156691:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae796300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+24:2363:x1875552173586688:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788666205.156707:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666205.156714:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9cd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428e5 expref: 24 pid: 5808 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.156729:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9cd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428e5 expref: 24 pid: 5808 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.156753:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9cd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428e5 expref: 24 pid: 5808 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.156768:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72f00) 00010000:00010000:2.0:1788666205.156773:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9d44 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.156782:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9d44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.156791:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9d44 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.156816:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666205.156878:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae796300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+23:2363:x1875552173586688:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 188us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666205.156887:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 37 00010000:00010000:3.0:1788666205.156967:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9d44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.156985:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9d44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788666205.157132:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1788666205.157374:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1788666205.157482:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae50b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5812:1875552186203776:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788666205.157539:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666205.157611:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab286278b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788666205.158731:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186203776 00000100:00100000:2.0:1788666205.158746:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186203776 00000100:00100000:2.0:1788666205.158837:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788666205.158850:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5812:x1875552186203776:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788666205.159005:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae50b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5812:x1875552186203776:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 157us (1464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666205.159014:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788666205.159070:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae50b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5812:1875552186203776:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1788666205.159270:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1788666205.161760:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788666205.162269:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab298b96a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5812:1875552186203904:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788666205.162354:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666205.162440:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2c1b6b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666205.162487:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186203904 00000100:00100000:1.0:1788666205.162495:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186203904 00000100:00100000:1.0:1788666205.162601:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788666205.162612:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5812:x1875552186203904:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788666205.162849:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5812:x1875552186203904:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 238us (495us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788666205.162858:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788666205.162982:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab298b96a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5812:1875552186203904:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788666205.163050:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1788666205.163102:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9d44 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.163114:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9d44 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.163122:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9d44 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.163128:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2e00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666205.163133:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9d44 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.163153:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9d44 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.163171:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72f00) 00010000:00010000:2.0:1788666205.163174:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788666205.163179:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9d44 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.163186:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9d44 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788666205.163397:0:5812:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788666205.163680:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788666205.163696:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 311872114989ns, next at 312872111675ns, rc = 0 00000001:00080000:2.0:1788666205.163704:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1788666205.163737:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72f00) 00010000:00010000:2.0:1788666205.163740:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788666205.163752:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9d2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4290f expref: 27 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666205.163894:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+26:10327:x1875552173586560:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 15847us (16117us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788666205.163904:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00000020:00080000:2.0:1788666205.163909:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788666205.169981:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666205.170328:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173586816 00000100:00100000:3.0:1788666205.170341:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173586816 00000100:00100000:3.0:1788666205.170488:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:3.0:1788666205.170502:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+26:10327:x1875552173586816:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1788666205.170558:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666205.170645:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9d4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42916 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.170750:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9d4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42916 expref: 27 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.170767:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9d4b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42916 expref: 27 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.170796:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:3.0:1788666205.170806:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788666205.170812:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814ffc00, rc 0) 00000100:00100000:3.0:1788666205.170902:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+27:10327:x1875552173586816:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 403us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666205.170936:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:0.0:1788666205.174998:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666205.175322:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173587072 00000100:00100000:3.0:1788666205.175343:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173587072 00000100:00100000:3.0:1788666205.175485:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:3.0:1788666205.175499:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28f367450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+27:10327:x1875552173587072:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1788666205.175929:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28f367450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+28:10327:x1875552173587072:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 432us (945us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788666205.175937:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00010000:00010000:0.0:1788666205.195004:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666205.287894:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666205.288024:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173587328 00000100:00100000:3.0:1788666205.288041:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173587328 00000100:00100000:3.0:1788666205.288140:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:3.0:1788666205.288155:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+28:10337:x1875552173587328:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1788666205.288205:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666205.288241:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9d52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d4291d expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666205.288410:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788666205.288658:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9d52 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4291d expref: 30 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.288678:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2a088e000) 00010000:00010000:3.0:1788666205.288682:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788666205.288689:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9d52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4291d expref: 30 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.288711:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814ff400, rc 0) 00000100:00100000:3.0:1788666205.288843:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+29:10337:x1875552173587328:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 692us (966us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1788666205.288854:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:0.0:1788666205.294916:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666205.295024:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173587456 00000100:00100000:1.0:1788666205.295036:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173587456 00000100:00100000:1.0:1788666205.295109:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:1.0:1788666205.295123:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+29:10337:x1875552173587456:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:1.0:1788666205.295271:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9d60 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295301:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9d60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295323:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9d60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295346:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854c00/0x96bbe788361e9d67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295354:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854c00/0x96bbe788361e9d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295387:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854c00/0x96bbe788361e9d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295538:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9d6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295548:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9d6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295556:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9d6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788666205.295680:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9d6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295700:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9d60 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295707:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9d60 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295717:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9d60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295724:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855a00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666205.295730:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9d60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295739:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9d60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295756:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:1.0:1788666205.295768:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666205.295776:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9d60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295783:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361e9d60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295803:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854c00/0x96bbe788361e9d67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295811:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854c00/0x96bbe788361e9d67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295817:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854c00/0x96bbe788361e9d67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295822:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298854c00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666205.295824:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854c00/0x96bbe788361e9d67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295830:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854c00/0x96bbe788361e9d67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295838:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab2908f2a00) 00010000:00010000:1.0:1788666205.295841:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666205.295844:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854c00/0x96bbe788361e9d67 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295850:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854c00/0x96bbe788361e9d67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295867:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9d6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295882:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9d6e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295888:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9d6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295893:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666205.295897:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9d6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295903:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9d6e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295911:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:1.0:1788666205.295914:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666205.295917:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9d6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.295922:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9d6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666205.296021:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+29:10337:x1875552173587456:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 898us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666205.296029:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:0.0:1788666205.299766:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666205.299905:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173587712 00000100:00100000:2.0:1788666205.299928:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173587712 00000100:00100000:2.0:1788666205.300019:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:2.0:1788666205.300031:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+29:10337:x1875552173587712:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1788666205.300447:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+30:10337:x1875552173587712:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 416us (699us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788666205.300456:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:0.0:1788666205.361481:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666205.361693:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173587968 00000100:00100000:3.0:1788666205.361708:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173587968 00000100:00100000:3.0:1788666205.361794:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:3.0:1788666205.361808:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+30:10340:x1875552173587968:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1788666205.361857:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666205.361891:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9d75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42924 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362015:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9d7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362034:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9d7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362048:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9d7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362068:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9d83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362076:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362082:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362280:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9d8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362309:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362317:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666205.362330:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788666205.362711:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9d7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362720:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9d7c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362728:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9d7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362735:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666205.362741:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9d7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362748:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9d7c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362764:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:3.0:1788666205.362767:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666205.362772:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9d7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362779:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9d7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362794:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362808:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9d83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362815:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9d83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362820:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666205.362824:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9d83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362830:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9d83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362838:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab2b9e72c00) 00010000:00010000:3.0:1788666205.362841:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666205.362844:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9d83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362850:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9d83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362905:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9d75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42924 expref: 33 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362920:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9d8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42924 expref: 32 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.362928:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:3.0:1788666205.362930:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788666205.362939:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814fe400, rc 0) 00000100:00100000:3.0:1788666205.363038:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+32:10340:x1875552173587968:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1232us (1572us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1788666205.363046:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:0.0:1788666205.379147:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666205.379370:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173588096 00000100:00100000:1.0:1788666205.379381:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173588096 00000100:00100000:1.0:1788666205.379464:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:1.0:1788666205.379478:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+32:10340:x1875552173588096:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:1.0:1788666205.379803:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9d98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.379848:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9d98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.379865:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9d98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.379904:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9d98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.379913:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9d98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.379922:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9d98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.379930:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666205.379935:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9d98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.379943:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9d98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.379956:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:1.0:1788666205.379961:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788666205.379966:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9d98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.379974:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361e9d98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666205.380126:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+32:10340:x1875552173588096:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 649us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666205.380144:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:0.0:1788666205.390079:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666205.390493:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173588352 00000100:00100000:2.0:1788666205.390733:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173588352 00000100:00100000:2.0:1788666205.390856:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:2.0:1788666205.390870:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+32:10340:x1875552173588352:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1788666205.391394:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+33:10340:x1875552173588352:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 524us (1325us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788666205.391833:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:0.0:1788666205.579135:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186204288:0@lo:400:kworker.0 00000100:00100000:0.0:1788666205.579248:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666205.579346:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788666205.579353:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186204416:0@lo:400:kworker.0 00000100:00100000:0.0:1788666205.579388:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666205.579513:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186204416 00000100:00100000:0.0:1788666205.579525:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186204416 00000100:00100000:2.0:1788666205.579642:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186204288 00000100:00100000:2.0:1788666205.579646:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186204288 00000100:00100000:2.0:1788666205.579716:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788666205.579730:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186204288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666205.579807:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186204288:12345-0@lo:400:kworker.0 Request processed in 81us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666205.579815:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788666205.579876:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186204288:0@lo:400:kworker.0 00000100:00080000:2.0:1788666205.579920:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666205.579999:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788666205.580005:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae794380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186204416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666205.580044:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae794380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186204416:12345-0@lo:400:kworker.0 Request processed in 38us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666205.580050:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788666205.580075:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186204416:0@lo:400:kworker.0 00000100:00100000:1.0:1788666205.580157:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab298b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186204032:0@lo:400:kworker.0 00000100:00100000:1.0:1788666205.580216:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666205.580250:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186204544:0@lo:400:kworker.0 00000100:00100000:1.0:1788666205.580273:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666205.580287:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788666205.580291:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab298b94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186204160:0@lo:400:kworker.0 00000100:00100000:1.0:1788666205.580304:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666205.580320:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186204672:0@lo:400:kworker.0 00000100:00100000:1.0:1788666205.580362:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666205.580393:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186204544 00000100:00080000:2.0:1788666205.580504:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788666205.581152:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186204032 00000100:00100000:0.0:1788666205.581165:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186204032 00000100:00100000:0.0:1788666205.581240:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788666205.581250:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186204032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666205.581323:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186204032:12345-0@lo:400:kworker.0 Request processed in 75us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666205.581330:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788666205.581534:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186204544 00000100:00100000:1.0:1788666205.581670:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186204160 00000100:00100000:1.0:1788666205.581675:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186204160 00000100:00100000:1.0:1788666205.581690:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788666205.581696:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae27aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186204544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666205.581738:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae27aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186204544:12345-0@lo:400:kworker.0 Request processed in 42us (1463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666205.581745:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788666205.581757:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788666205.581763:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186204160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666205.581792:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186204160:12345-0@lo:400:kworker.0 Request processed in 30us (1486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666205.581797:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1788666205.582074:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666205.582204:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186204672 00000100:00100000:3.0:1788666205.582211:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186204672 00000100:00100000:3.0:1788666205.582257:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788666205.582266:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3275:x1875552186204672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666205.582320:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290507b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3275:x1875552186204672:12345-0@lo:400:kworker.0 Request processed in 56us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666205.582325:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788666205.582757:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab298b95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186204032:0@lo:400:kworker.0 00000100:00100000:0.0:1788666205.582787:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186204544:0@lo:400:kworker.0 00000100:00100000:0.0:1788666205.582850:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab298b94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186204160:0@lo:400:kworker.0 00000100:00100000:0.0:1788666205.582866:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1e04000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186204672:0@lo:400:kworker.0 00000100:00100000:0.0:1788666205.814074:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666205.814398:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173588608 00000100:00100000:1.0:1788666205.814425:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173588608 00000100:00100000:2.0:1788666205.814833:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:2.0:1788666205.814853:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+33:10371:x1875552173588608:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:2.0:1788666205.814886:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666205.815036:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9d9f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d4292b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.815284:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9da6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.815301:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9da6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.815391:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9da6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666205.815405:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788666205.815855:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9d9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4292b expref: 36 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.815878:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9da6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4292b expref: 35 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.815887:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:2.0:1788666205.815890:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666205.815894:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2400, rc 0) 00000100:00100000:2.0:1788666205.816985:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae797b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+35:10371:x1875552173588608:12345-192.168.201.25@tcp:101:cat.0 Request processed in 2132us (2923us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788666205.816997:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:0.0:1788666205.822023:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666205.822213:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173588864 00000100:00100000:3.0:1788666205.822230:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173588864 00000100:00100000:3.0:1788666205.822361:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:3.0:1788666205.822375:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+35:10371:x1875552173588864:12345-192.168.201.25@tcp:35:cat.0 00000100:00100000:3.0:1788666205.822782:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+36:10371:x1875552173588864:12345-192.168.201.25@tcp:35:cat.0 Request processed in 409us (768us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788666205.822792:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:0.0:1788666205.828269:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666205.833794:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173588992 00000100:00100000:2.0:1788666205.833817:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173588992 00000100:00100000:2.0:1788666205.834067:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:2.0:1788666205.834085:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a096f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+36:2364:x1875552173588992:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788666205.834104:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666205.834158:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9da6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4292b expref: 36 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.834183:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:2.0:1788666205.834200:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666205.835617:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a096f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+35:2364:x1875552173588992:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 230us (6058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666205.835635:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:0.0:1788666205.927169:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666205.927407:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173589248 00000100:00100000:3.0:1788666205.927426:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173589248 00000100:00100000:3.0:1788666205.927566:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:3.0:1788666205.927615:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+35:10377:x1875552173589248:12345-192.168.201.25@tcp:101:dd.0 00010000:00010000:3.0:1788666205.927728:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666205.927736:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788666205.927785:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361e9d0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42901 expref: 35 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.927858:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:3.0:1788666205.927867:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788666205.927893:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9db4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42932 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.928242:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9dbb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.928261:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9d8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42924 expref: 35 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.928272:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9dbb lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.928545:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9d8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42924 expref: 35 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.928568:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9d8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42924 expref: 35 pid: 7132 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666205.928752:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae509880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875552186204800:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788666205.928919:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab286278cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788666205.932750:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae509880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875552186204800:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788666205.932807:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9dbb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666205.936775:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666205.936998:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173589376 00000100:00100000:1.0:1788666205.937011:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173589376 00010000:00010000:1.0:1788666205.937066:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9d8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42924 expref: 36 pid: 7132 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666205.937124:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:1.0:1788666205.937136:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae794e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+36:2364:x1875552173589376:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666205.937157:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666205.937165:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9d8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42924 expref: 36 pid: 7132 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.937180:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9d8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42924 expref: 36 pid: 7132 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.937218:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9d8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42924 expref: 36 pid: 7132 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.937238:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:1.0:1788666205.937244:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9dbb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.937256:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9dbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.937264:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9dbb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666205.937295:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666205.937384:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae794e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+35:2364:x1875552173589376:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 249us (621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666205.937411:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 38 00010000:00010000:3.0:1788666205.939117:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9dbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.939152:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9dbb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666205.939179:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788666205.939393:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9db4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42932 expref: 36 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.939417:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9dbb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42932 expref: 35 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.939427:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:3.0:1788666205.939430:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788666205.939433:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814ff800, rc 0) 00000100:00100000:3.0:1788666205.939510:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+35:10377:x1875552173589248:12345-192.168.201.25@tcp:101:dd.0 Request processed in 11931us (12356us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1788666205.939520:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:1.0:1788666205.943353:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666205.943512:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173589632 00000100:00100000:2.0:1788666205.943526:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173589632 00000100:00100000:2.0:1788666205.943645:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:2.0:1788666205.943668:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+35:10377:x1875552173589632:12345-192.168.201.25@tcp:36:dd.0 00010000:00010000:2.0:1788666205.944007:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361e9dc9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.944026:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361e9dc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666205.944038:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361e9dc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788666205.944107:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788666205.944133:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cb336653 reply state 00000000615d0e2c transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361e9dc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666205.944142:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788666205.944257:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290505c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+38:10377:x1875552173589632:12345-192.168.201.25@tcp:36:dd.0 Request processed in 600us (913us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788666205.944264:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 52 00000020:00080000:2.0:1788666205.944270:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788666205.948065:0:3261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361e9dc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.948102:0:3261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361e9dc9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.948112:0:3261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361e9dc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.948121:0:3261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666205.948127:0:3261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361e9dc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.948158:0:3261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361e9dc9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.948179:0:3261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:3.0:1788666205.948192:0:3261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666205.948198:0:3261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361e9dc9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666205.948205:0:3261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361e9dc9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666206.091002:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186204928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788666206.091081:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666206.091266:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186204928 00000100:00100000:1.0:1788666206.091278:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186204928 00000100:00100000:1.0:1788666206.091356:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788666206.091368:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1875552186204928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788666206.091401:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666206.096466:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1875552186204928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5085us (5370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666206.096484:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788666206.099980:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186204928:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788666206.218859:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788666206.283276:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788666206.401251:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666206.401373:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173589760 00000100:00100000:0.0:1788666206.401389:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173589760 00000100:00100000:0.0:1788666206.401486:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 53 00000100:00100000:0.0:1788666206.401500:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+37:10391:x1875552173589760:12345-192.168.201.25@tcp:101:stat.0 00010000:00010000:0.0:1788666206.401546:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666206.401612:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361e9dd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42939 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.401712:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9dd7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.401728:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.401741:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.401754:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9dde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.401759:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9dde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.401764:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9dde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.401891:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9de5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.401922:0:7132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9dbb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42932 expref: 38 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.401931:0:7132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9de5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.401971:0:7132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9dbb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42932 expref: 38 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.401983:0:7132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9dbb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42932 expref: 38 pid: 5809 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666206.401998:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae795f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186205056:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788666206.402147:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a4282a80 going to sleep for 11 seconds 00000100:00080000:2.0:1788666206.402656:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666206.407121:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666206.407251:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173590016 00000100:00100000:3.0:1788666206.407264:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173590016 00000100:00100000:3.0:1788666206.407342:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:3.0:1788666206.407355:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+39:5601:x1875552173590016:12345-192.168.201.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788666206.407950:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+40:5601:x1875552173590016:12345-192.168.201.25@tcp:35:ldlm_bl.0 Request processed in 594us (840us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1788666206.407962:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:0.0:1788666206.408113:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae795f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186205056:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788666206.408150:0:7132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9de5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666206.418049:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666206.418199:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173590144 00000100:00100000:2.0:1788666206.418215:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173590144 00010000:00010000:2.0:1788666206.418287:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9dbb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42932 expref: 40 pid: 5809 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666206.418357:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:2.0:1788666206.418374:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290504e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+40:2363:x1875552173590144:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788666206.418409:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666206.418421:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9dbb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42932 expref: 40 pid: 5809 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.418440:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9dbb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42932 expref: 40 pid: 5809 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.418473:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9dbb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42932 expref: 40 pid: 5809 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.418502:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:2.0:1788666206.418510:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9de5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.418534:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.418571:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9de5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.418689:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666206.418770:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290504e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+39:2363:x1875552173590144:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 399us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666206.418781:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 39 00010000:00010000:0.0:1788666206.419797:0:7132:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.420043:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666206.420127:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788666206.420134:0:7132:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788666206.420231:0:7132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.420284:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9de5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.420301:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9dd7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.420310:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9dd7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.420321:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9dd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.420328:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144a600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666206.420334:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9dd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.420343:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9dd7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.420363:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:0.0:1788666206.420368:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666206.420374:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9dd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.420382:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361e9dd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.420406:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9dde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.420413:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9dde lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.420433:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9dde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.420438:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144a800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666206.420442:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9dde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.420449:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9dde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.420459:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab290a48300) 00010000:00010000:0.0:1788666206.420462:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666206.420465:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9dde lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.420471:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9dde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.420552:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361e9dd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42939 expref: 39 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.420574:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9de5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42939 expref: 38 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.420786:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:0.0:1788666206.420788:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788666206.420791:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144b400, rc 0) 00000100:00100000:0.0:1788666206.421247:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290504000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+38:10391:x1875552173589760:12345-192.168.201.25@tcp:101:stat.0 Request processed in 19745us (20009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666206.421276:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 53 00000100:00100000:1.0:1788666206.567705:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666206.568535:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173590400 00000100:00100000:2.0:1788666206.568554:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173590400 00000100:00100000:2.0:1788666206.568758:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 54 00000100:00100000:2.0:1788666206.568782:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+38:10397:x1875552173590400:12345-192.168.201.25@tcp:36:truncate.0 00010000:00010000:2.0:1788666206.568886:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666206.568929:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9de5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42939 expref: 38 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.568959:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:2.0:1788666206.568967:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788666206.571389:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9dec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.571425:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9dec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.571443:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9dec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788666206.572796:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1788666206.573309:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9608773 reply state 00000000b1fb4a59 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9dec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666206.573352:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788666206.573685:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290507480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+40:10397:x1875552173590400:12345-192.168.201.25@tcp:36:truncate.0 Request processed in 4908us (5990us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788666206.573698:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 54 00000020:00080000:2.0:1788666206.573706:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788666206.578302:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9dec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666206.578334:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9dec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666206.578344:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9dec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666206.578352:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666206.578386:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9dec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666206.578399:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9dec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666206.578427:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:3.0:1788666206.578431:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666206.578439:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9dec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666206.578447:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9dec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666206.828839:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666206.829105:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173590528 00000100:00100000:2.0:1788666206.829124:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173590528 00000100:00100000:2.0:1788666206.829225:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 55 00000100:00100000:2.0:1788666206.829237:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+39:10410:x1875552173590528:12345-192.168.201.25@tcp:101:stat.0 00010000:00010000:2.0:1788666206.829278:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666206.829315:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9df3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42940 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829424:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9dfa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829444:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9dfa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829460:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9dfa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829480:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829487:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829494:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829679:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829688:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829696:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666206.829743:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788666206.829748:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788666206.829788:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829802:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829812:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9dfa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829819:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9dfa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829827:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9dfa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829833:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666206.829839:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9dfa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829849:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9dfa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829871:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:2.0:1788666206.829874:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666206.829880:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9dfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829888:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9dfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829903:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829909:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829915:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829921:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666206.829924:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829930:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829935:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab2a088ef00) 00010000:00010000:2.0:1788666206.829937:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666206.829940:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829946:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.829992:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9df3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42940 expref: 41 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.830008:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42940 expref: 40 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666206.830016:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:2.0:1788666206.830018:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666206.830021:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2800, rc 0) 00000100:00100000:2.0:1788666206.830123:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290505f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+40:10410:x1875552173590528:12345-192.168.201.25@tcp:101:stat.0 Request processed in 887us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666206.830131:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 55 00000100:00100000:1.0:1788666206.957405:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666206.957878:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173590784 00000100:00100000:0.0:1788666206.957893:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173590784 00000100:00100000:0.0:1788666206.958014:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:0.0:1788666206.958029:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+40:10421:x1875552173590784:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788666206.958089:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666206.958372:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361e9e0f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42947 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666206.958532:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788666206.958949:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361e9e0f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42947 expref: 42 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.958972:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2a088e000) 00010000:00010000:0.0:1788666206.958976:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788666206.958983:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361e9e0f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42947 expref: 42 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666206.959333:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144ae00, rc 0) 00000100:00100000:0.0:1788666206.960262:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+41:10421:x1875552173590784:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1447us (2367us total) trans 4294967339 rc 301/301 00000100:00100000:0.0:1788666206.960278:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:1.0:1788666206.971771:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666206.975451:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173591040 00000100:00100000:2.0:1788666206.975470:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173591040 00000100:00100000:2.0:1788666206.976189:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:2.0:1788666206.976207:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+41:10421:x1875552173591040:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1788666206.977071:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+42:10421:x1875552173591040:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 866us (5313us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788666206.977082:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:1.0:1788666207.095868:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666207.096022:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173591296 00000100:00100000:2.0:1788666207.096036:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173591296 00000100:00100000:2.0:1788666207.096126:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:2.0:1788666207.096137:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+42:10427:x1875552173591296:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:2.0:1788666207.096177:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666207.096204:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e1d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d4294e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.096366:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e24 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.096383:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42940 expref: 43 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.096394:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e24 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.096450:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42940 expref: 43 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.096467:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42940 expref: 43 pid: 5809 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666207.096483:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1e05f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875552186205184:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788666207.096691:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28a924300 going to sleep for 11 seconds 00000100:00100000:1.0:1788666207.104831:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666207.104950:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173591424 00000100:00100000:0.0:1788666207.104962:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173591424 00010000:00010000:0.0:1788666207.105034:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e08 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42940 expref: 44 pid: 5809 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666207.105113:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:0.0:1788666207.105130:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290505180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+44:2363:x1875552173591424:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788666207.105155:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666207.105174:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e08 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42940 expref: 44 pid: 5809 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666207.105189:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42940 expref: 44 pid: 5809 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666207.105216:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:0.0:1788666207.105223:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e24 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666207.105235:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666207.105245:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e24 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666207.105267:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666207.105330:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290505180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+44:2363:x1875552173591424:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 205us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666207.105338:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 40 00010000:00010000:2.0:1788666207.107379:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42940 expref: 43 pid: 5809 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666207.107414:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1e05f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875552186205184:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666207.107444:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.107455:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.107483:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e24 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666207.108702:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788666207.108929:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e1d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4294e expref: 44 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.108957:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e24 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4294e expref: 43 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.108968:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:2.0:1788666207.108972:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788666207.108975:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f3800, rc 0) 00000100:00100000:2.0:1788666207.111295:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+43:10427:x1875552173591296:12345-192.168.201.25@tcp:101:bash.0 Request processed in 15146us (15427us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788666207.111311:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:0.0:1788666207.116811:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666207.119340:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab290506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186205312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788666207.119535:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666207.119901:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186205312 00000100:00100000:1.0:1788666207.119916:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186205312 00000100:00100000:1.0:1788666207.120069:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788666207.120082:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186205312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788666207.120145:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666207.120232:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186205312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666207.120241:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788666207.120348:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab290506d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186205312:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788666207.120632:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788666207.122414:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173591680 00000100:00100000:2.0:1788666207.122442:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173591680 00000100:00100000:2.0:1788666207.123705:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 58 00000100:00100000:2.0:1788666207.123729:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+43:10427:x1875552173591680:12345-192.168.201.25@tcp:36:bash.0 00010000:00010000:2.0:1788666207.124113:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.124141:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.124171:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788666207.124319:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788666207.124350:0:5808:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae9d4cd2 reply state 0000000010d3f5e7 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666207.124361:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788666207.124513:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+46:10427:x1875552173591680:12345-192.168.201.25@tcp:36:bash.0 Request processed in 793us (7710us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788666207.124524:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 58 00000020:00080000:2.0:1788666207.124533:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788666207.137343:0:3261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.137362:0:3261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.137370:0:3261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.137377:0:3261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666207.137382:0:3261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.137391:0:3261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.137410:0:3261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:2.0:1788666207.137413:0:3261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666207.137417:0:3261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.137424:0:3261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666207.146117:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666207.146271:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173591808 00000100:00100000:0.0:1788666207.146282:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173591808 00000100:00100000:0.0:1788666207.146346:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00100000:0.0:1788666207.146376:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+45:10427:x1875552173591808:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:0.0:1788666207.146408:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666207.146435:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361e9e39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42955 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666207.146546:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9e40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666207.146565:0:7132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e24 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4294e expref: 46 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666207.146575:0:7132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9e40 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666207.146650:0:7132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e24 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4294e expref: 46 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666207.146666:0:7132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e24 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4294e expref: 46 pid: 5809 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666207.146683:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae796680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186205440:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788666207.146780:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a4282c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788666207.162267:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666207.162461:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae796680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186205440:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788666207.162518:0:7132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9e40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666207.162875:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173591936 00000100:00100000:2.0:1788666207.162883:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173591936 00010000:00010000:2.0:1788666207.162927:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e24 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4294e expref: 47 pid: 5809 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666207.162971:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 41 00000100:00100000:2.0:1788666207.162981:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290507800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+47:2363:x1875552173591936:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788666207.162995:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666207.163152:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e24 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4294e expref: 47 pid: 5809 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.163177:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e24 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4294e expref: 47 pid: 5809 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.163204:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e24 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4294e expref: 47 pid: 5809 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.163222:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:2.0:1788666207.163227:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9e40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.163238:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9e40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.163246:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9e40 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.163265:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666207.163341:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290507800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+46:2363:x1875552173591936:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 361us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666207.163351:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 41 00010000:00010000:0.0:1788666207.163498:0:7132:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9e40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666207.163608:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9e40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666207.163658:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788666207.163664:0:7132:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788666207.163687:0:7132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9e40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666207.163720:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361e9e39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42955 expref: 46 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666207.163738:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9e40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42955 expref: 45 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666207.163745:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:0.0:1788666207.163748:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788666207.163751:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144a800, rc 0) 00000100:00100000:0.0:1788666207.163782:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290506d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+45:10427:x1875552173591808:12345-192.168.201.25@tcp:101:bash.0 Request processed in 17410us (17682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666207.163790:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00100000:1.0:1788666207.193887:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666207.197777:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173592192 00000100:00100000:3.0:1788666207.197802:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173592192 00000100:00100000:3.0:1788666207.197892:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:3.0:1788666207.197905:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28f364850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+45:10427:x1875552173592192:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:3.0:1788666207.198266:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28f364850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+46:10427:x1875552173592192:12345-192.168.201.25@tcp:35:bash.0 Request processed in 363us (4399us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1788666207.198350:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00010000:00010000:1.0:1788666207.242880:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666207.309490:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666207.312381:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173592448 00000100:00100000:2.0:1788666207.312414:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173592448 00000100:00100000:2.0:1788666207.312529:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:2.0:1788666207.312542:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+46:10437:x1875552173592448:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666207.312572:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666207.312650:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d4295c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666207.312754:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788666207.312895:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e47 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4295c expref: 48 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.312914:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2a088e000) 00010000:00010000:2.0:1788666207.312917:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788666207.312924:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4295c expref: 48 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.312943:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f3800, rc 0) 00000100:00100000:2.0:1788666207.313023:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290507100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+47:10437:x1875552173592448:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 485us (3552us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1788666207.313031:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:0.0:1788666207.318232:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666207.318488:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173592576 00000100:00100000:2.0:1788666207.318503:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173592576 00000100:00100000:2.0:1788666207.318617:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:2.0:1788666207.318629:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+47:10437:x1875552173592576:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:2.0:1788666207.318769:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e55 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.318789:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.318807:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.318827:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.318834:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.318840:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.318949:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.318959:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.318968:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788666207.319037:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.319054:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.319072:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.319079:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.319086:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666207.319091:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.319099:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e55 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.319112:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:2.0:1788666207.319126:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666207.319131:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.319137:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.319153:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.319167:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.319173:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.319178:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666207.319197:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.319204:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.319211:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab2a088ef00) 00010000:00010000:2.0:1788666207.319214:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666207.319217:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.319222:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.319249:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.319255:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.319261:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.319265:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666207.319268:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.319273:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.319280:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:2.0:1788666207.319283:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666207.319291:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.319297:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666207.319385:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+47:10437:x1875552173592576:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 756us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666207.319394:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:1.0:1788666207.326720:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666207.326877:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173592832 00000100:00100000:3.0:1788666207.326887:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173592832 00000100:00100000:3.0:1788666207.326945:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:3.0:1788666207.326955:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+47:10437:x1875552173592832:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1788666207.327473:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+48:10437:x1875552173592832:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 516us (770us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788666207.327501:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:1.0:1788666207.376664:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666207.376984:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173593088 00000100:00100000:2.0:1788666207.376995:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173593088 00000100:00100000:2.0:1788666207.377143:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 62 00000100:00100000:2.0:1788666207.377166:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+48:10440:x1875552173593088:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666207.377193:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666207.377215:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42963 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.377366:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e71 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.377384:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.377397:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.377415:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.377423:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.377441:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.377689:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9e7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.377710:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9e7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.377719:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9e7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666207.377731:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788666207.377854:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e71 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.377863:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e71 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.377870:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.377876:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666207.377880:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.377890:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e71 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.377904:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:2.0:1788666207.377907:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666207.377921:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.377929:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9e71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.377946:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.377951:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.377956:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.377962:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666207.377964:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.377970:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.377978:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab2a088ef00) 00010000:00010000:2.0:1788666207.377980:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666207.377983:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e78 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.377988:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9e78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.378032:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42963 expref: 51 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.378057:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9e7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42963 expref: 50 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.378065:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:2.0:1788666207.378067:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666207.378070:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2200, rc 0) 00000100:00100000:2.0:1788666207.378149:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290504700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+50:10440:x1875552173593088:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 995us (1497us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788666207.378157:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 62 00000100:00100000:0.0:1788666207.404155:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666207.404332:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666207.404412:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173593216 00000100:00100000:2.0:1788666207.404424:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173593216 00000100:00100000:2.0:1788666207.404500:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:2.0:1788666207.404512:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+50:10440:x1875552173593216:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:2.0:1788666207.404621:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.404640:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.404653:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.404684:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.404692:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.404726:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.404732:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666207.404737:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.404745:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.404757:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:2.0:1788666207.404761:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788666207.404766:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.404772:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9e8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666207.404850:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae795500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+50:10440:x1875552173593216:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 341us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666207.404858:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:1.0:1788666207.405085:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173593344 00000100:00100000:1.0:1788666207.405091:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173593344 00000100:00100000:1.0:1788666207.405133:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:1.0:1788666207.405140:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae797100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+50:2361:x1875552173593344:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666207.405150:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666207.405174:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9e7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42963 expref: 50 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666207.405185:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:1.0:1788666207.405189:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666207.405210:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae797100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+49:2361:x1875552173593344:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 71us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666207.405218:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:1.0:1788666207.414670:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666207.420103:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173593600 00000100:00100000:3.0:1788666207.420195:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173593600 00000100:00100000:3.0:1788666207.420460:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:3.0:1788666207.420472:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+49:10440:x1875552173593600:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1788666207.420836:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+50:10440:x1875552173593600:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 366us (6181us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788666207.420845:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:3.0:1788666207.583670:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666207.584645:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173593856 00000100:00100000:0.0:1788666207.584660:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173593856 00000100:00100000:0.0:1788666207.584741:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:0.0:1788666207.584755:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+50:10458:x1875552173593856:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:0.0:1788666207.584819:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666207.584852:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361e9e94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d4296a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666207.584996:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9e9b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666207.585014:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9e9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666207.585027:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9e9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666207.585040:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788666207.585226:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361e9e94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4296a expref: 53 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666207.585250:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9e9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4296a expref: 52 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666207.585261:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:0.0:1788666207.585265:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788666207.585270:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144b400, rc 0) 00000100:00100000:0.0:1788666207.585364:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae508700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+52:10458:x1875552173593856:12345-192.168.201.25@tcp:101:cat.0 Request processed in 612us (1708us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788666207.585372:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:0.0:1788666207.626822:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666207.626959:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173593984 00000100:00100000:2.0:1788666207.626977:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173593984 00000100:00100000:2.0:1788666207.627051:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 65 00000100:00100000:2.0:1788666207.627062:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+52:10459:x1875552173593984:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666207.627089:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666207.627123:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9ea9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42971 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.627305:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9eb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.627327:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.627345:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666207.627399:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788666207.627405:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788666207.627428:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9eb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.627459:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9ea9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42971 expref: 54 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.627482:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9eb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42971 expref: 53 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.627491:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:2.0:1788666207.627495:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788666207.627499:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f3800, rc 0) 00000100:00100000:2.0:1788666207.627627:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+53:10459:x1875552173593984:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 521us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666207.627633:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 65 00000100:00100000:1.0:1788666207.643519:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666207.644447:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173594368 00000100:00100000:2.0:1788666207.644462:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173594368 00000100:00100000:2.0:1788666207.644549:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:2.0:1788666207.644563:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+53:10459:x1875552173594368:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1788666207.644954:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+54:10459:x1875552173594368:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 393us (1447us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788666207.644963:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:3.0:1788666207.649008:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666207.650570:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173594496 00000100:00100000:2.0:1788666207.650650:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173594496 00000100:00100000:2.0:1788666207.650765:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:2.0:1788666207.650777:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+54:10459:x1875552173594496:12345-192.168.201.25@tcp:103:lfs.0 00010000:00010000:2.0:1788666207.650797:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788666207.650832:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361e9e40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42955 expref: 54 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.650865:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361e9e9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4296a expref: 53 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.650880:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9d4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42916 expref: 52 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.650893:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72800) 00010000:00010000:2.0:1788666207.650924:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666207.651033:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+51:10459:x1875552173594496:12345-192.168.201.25@tcp:103:lfs.0 Request processed in 259us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666207.651041:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:0.0:1788666207.656266:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666207.657262:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173594624 00000100:00100000:2.0:1788666207.657277:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173594624 00000100:00100000:2.0:1788666207.658250:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 66 00000100:00100000:2.0:1788666207.658295:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+51:10459:x1875552173594624:12345-192.168.201.25@tcp:58:lfs.0 00010000:00010000:2.0:1788666207.660703:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9eb7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.661134:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9eb7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.661243:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9eb7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788666207.663730:0:5808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788666207.664005:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788666207.664120:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788666207.664379:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+51:10459:x1875552173594624:12345-192.168.201.25@tcp:58:lfs.0 Request processed in 6082us (8119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666207.664398:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 66 00000100:00100000:1.0:1788666207.743933:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666207.745071:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173594752 00000100:00100000:2.0:1788666207.745104:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173594752 00000100:00100000:2.0:1788666207.745237:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 67 00000100:00100000:2.0:1788666207.745252:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+51:10461:x1875552173594752:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666207.745289:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666207.745319:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9ebe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42978 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.747318:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361e9ec5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.747344:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361e9ec5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.747383:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361e9ec5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.747403:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9ecc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.747411:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9ecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.747419:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9ecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.748352:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9ed3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.748368:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.748377:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666207.749264:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788666207.749275:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788666207.749312:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.749330:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9ed3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.749342:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361e9ec5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.749376:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361e9ec5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.749384:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361e9ec5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.749391:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666207.749396:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361e9ec5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.749407:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361e9ec5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.749424:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:2.0:1788666207.749429:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666207.749435:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361e9ec5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.749458:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361e9ec5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.749481:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9ecc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.749487:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9ecc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.749493:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9ecc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.749498:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2e00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666207.750717:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9ecc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.750729:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9ecc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.750743:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab2a088e600) 00010000:00010000:2.0:1788666207.750747:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666207.750751:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9ecc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.750757:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9ecc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.750813:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9ebe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42978 expref: 53 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.750829:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42978 expref: 52 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666207.750837:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2a088ef00) 00010000:00010000:2.0:1788666207.750839:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788666207.750842:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2400, rc 0) 00000100:00100000:2.0:1788666207.750909:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290504380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+52:10461:x1875552173594752:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 5661us (6995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666207.750918:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 67 00010000:00010000:0.0:1788666208.268745:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788666208.333686:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788666208.333702:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788666208.333777:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788666208.333790:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788666208.333990:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae797480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875552186205568:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788666208.334091:0:11650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a4282000 going to sleep for 11 seconds 00000100:00100000:1.0:1788666208.346836:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666208.346885:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173594880 00000100:00100000:1.0:1788666208.346894:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173594880 00000100:00100000:1.0:1788666208.346970:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:1.0:1788666208.346981:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0911d461-5865-4ef7-8c3e-012fc04add58+53:10472:x1875552173594880:12345-192.168.201.25@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788666208.347086:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0911d461-5865-4ef7-8c3e-012fc04add58+53:10472:x1875552173594880:12345-192.168.201.25@tcp:900:lhsmtool_posix.0 Request processed in 107us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666208.347093:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00080000:1.0:1788666208.347115:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788666208.349599:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae797480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875552186205568:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788666208.353074:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666208.353539:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173595008 00000100:00100000:1.0:1788666208.353555:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173595008 00000100:00100000:1.0:1788666208.353678:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:1.0:1788666208.353691:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+52:10472:x1875552173595008:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788666208.353741:0:5810:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788666208.353908:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+52:10472:x1875552173595008:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 220us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666208.353917:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:0.0:1788666208.361719:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666208.362667:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173595136 00000100:00100000:3.0:1788666208.362679:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173595136 00000100:00100000:3.0:1788666208.362760:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:3.0:1788666208.362773:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+52:10472:x1875552173595136:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788666208.362900:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9eda lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.362926:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9eda lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.362945:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9eda lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.362962:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9ee1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.362970:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.362990:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363022:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9ee8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363031:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363054:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666208.363103:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788666208.363109:0:7132:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788666208.363131:0:7132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363165:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9eda lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363175:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9eda lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363184:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9eda lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363191:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666208.363198:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9eda lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363207:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9eda lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363233:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab2908f2b00) 00010000:00010000:3.0:1788666208.363237:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666208.363245:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9eda lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363254:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9eda lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363270:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363278:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9ee1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363284:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9ee1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363290:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666208.363293:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9ee1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363299:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9ee1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363307:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8ab2b9e72c00) 00010000:00010000:3.0:1788666208.363310:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666208.363312:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9ee1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363318:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9ee1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363347:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363354:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9ee8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363361:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363368:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff000 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666208.363371:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363377:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9ee8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363385:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2a088ef00) 00010000:00010000:3.0:1788666208.363388:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666208.363391:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9ee8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.363397:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9ee8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666208.363511:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+52:10472:x1875552173595136:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 Request processed in 738us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666208.363521:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:1.0:1788666208.374894:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666208.375004:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173595392 00000100:00100000:3.0:1788666208.375019:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173595392 00000100:00100000:3.0:1788666208.376540:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 70 00000100:00100000:3.0:1788666208.376571:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+52:10472:x1875552173595392:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788666208.376618:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666208.376643:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9eef lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d4297f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.376794:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9ef6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.376818:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.376837:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666208.376854:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788666208.377018:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9ef6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.377027:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9ef6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.377035:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.377043:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ffc00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666208.377048:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9ef6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.377057:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9ef6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.377071:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2a088ef00) 00010000:00010000:3.0:1788666208.377080:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788666208.377086:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9ef6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.377093:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9ef6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.377161:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9eef lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4297f expref: 54 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.377174:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab2908f2b00) 00010000:00010000:3.0:1788666208.377176:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788666208.377180:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9eef lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4297f expref: 54 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.377191:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814fe600, rc 0) 00000100:00100000:3.0:1788666208.377331:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+53:10472:x1875552173595392:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 768us (2458us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1788666208.377339:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 70 00000100:00100000:1.0:1788666208.400786:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666208.400842:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173595520 00000100:00100000:1.0:1788666208.400857:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173595520 00000100:00100000:1.0:1788666208.400934:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 71 00000100:00100000:1.0:1788666208.400948:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+53:10472:x1875552173595520:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788666208.401023:0:7132:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788666208.401192:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+53:10472:x1875552173595520:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 246us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666208.401201:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 71 00000100:00100000:1.0:1788666208.411527:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666208.411651:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173595776 00000100:00100000:3.0:1788666208.411664:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173595776 00000100:00100000:3.0:1788666208.411731:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 72 00000100:00100000:3.0:1788666208.411745:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+53:10472:x1875552173595776:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788666208.411777:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666208.411780:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788666208.411817:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9eb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42971 expref: 53 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.411838:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:3.0:1788666208.411854:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788666208.411873:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9f04 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42986 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788666208.412524:0:5810:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788666208.412824:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9f0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.412840:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9f0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.412854:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9f0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.412928:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9f04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42986 expref: 55 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.412950:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9f0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42986 expref: 54 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.412960:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab2b9e72c00) 00010000:00010000:3.0:1788666208.412963:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788666208.412966:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814ffc00, rc 0) 00000100:00100000:3.0:1788666208.413055:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+54:10472:x1875552173595776:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 1313us (1540us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788666208.413064:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 72 00000100:00100000:1.0:1788666208.424547:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666208.424653:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173596032 00000100:00100000:3.0:1788666208.424663:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173596032 00000100:00100000:3.0:1788666208.424729:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 73 00000100:00100000:3.0:1788666208.424740:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+54:10472:x1875552173596032:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788666208.424802:0:7132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666208.424825:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9f0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42986 expref: 54 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.424839:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab2b9e72c00) 00010000:00010000:3.0:1788666208.424850:0:7132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788666208.424870:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9f19 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.424882:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9f19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.424889:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9f19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.424899:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc6453ab8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.424903:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc6453ab8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.424907:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc6453ab8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.424969:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9f19 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.424973:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9f19 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.424978:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9f19 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.424987:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff000 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666208.424991:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9f19 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.424997:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9f19 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.425003:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:3.0:1788666208.425005:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666208.425007:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9f19 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.425012:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9f19 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.425017:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc6453ab8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.425021:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc6453ab8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.425024:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc6453ab8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.425027:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666208.425029:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc6453ab8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.425032:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc6453ab8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.425047:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc6453ab8 (ffff8ab2b9e72300) 00010000:00010000:3.0:1788666208.425049:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666208.425052:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc6453ab8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.425058:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc6453ab8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666208.425219:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+53:10472:x1875552173596032:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 477us (682us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788666208.425228:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 73 00000100:00100000:3.0:1788666208.427326:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666208.427877:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173596160 00000100:00100000:1.0:1788666208.427891:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173596160 00000100:00100000:1.0:1788666208.427961:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 74 00000100:00100000:1.0:1788666208.427971:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+53:10472:x1875552173596160:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788666208.427992:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666208.428018:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854a00/0x96bbe788361e9f27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d4298d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666208.428060:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361e9f2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666208.428074:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361e9f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666208.428087:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361e9f2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666208.428218:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854a00/0x96bbe788361e9f27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4298d expref: 55 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666208.428235:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361e9f2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4298d expref: 54 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666208.428246:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab2908f2200) 00010000:00010000:1.0:1788666208.428250:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788666208.428554:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298854400, rc 0) 00000100:00100000:1.0:1788666208.429062:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae508a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+54:10472:x1875552173596160:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 1088us (1746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666208.429076:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 74 00000100:00100000:0.0:1788666208.431909:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666208.432048:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173596416 00000100:00100000:3.0:1788666208.432061:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173596416 00000100:00100000:3.0:1788666208.432163:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 75 00000100:00100000:3.0:1788666208.432175:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+54:10472:x1875552173596416:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788666208.432284:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.432303:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.432316:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788666208.432657:0:7132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788666208.432666:0:7132:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 315141085304ns, next at 316141083719ns, rc = 0 00000004:00010000:3.0:1788666208.432745:0:7132:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000090d1e90 reply state 0000000073e7483e transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666208.432765:0:7132:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788666208.432855:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+56:10472:x1875552173596416:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 684us (959us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788666208.432860:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 75 00010000:00010000:3.0:1788666208.434234:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.434251:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.434334:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.434341:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666208.434346:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.434355:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.434378:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab2908f2200) 00010000:00010000:3.0:1788666208.434382:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788666208.434387:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.434393:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666208.434902:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666208.435078:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173596544 00000100:00100000:3.0:1788666208.435088:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173596544 00000100:00100000:3.0:1788666208.435219:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 76 00000100:00100000:3.0:1788666208.435231:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+55:10472:x1875552173596544:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788666208.435272:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666208.435292:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9f3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42994 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.435359:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9f3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42994 expref: 56 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.435369:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9f3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42994 expref: 56 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.435389:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab2908f2200) 00010000:00010000:3.0:1788666208.435392:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788666208.435395:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814ff000, rc 0) 00000100:00100000:3.0:1788666208.435458:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+56:10472:x1875552173596544:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 229us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666208.435465:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 76 00000100:00100000:0.0:1788666208.437874:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666208.438012:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173596672 00000100:00100000:2.0:1788666208.438023:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173596672 00000100:00100000:2.0:1788666208.438166:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:2.0:1788666208.438175:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2357:x1875552173596672:12345-192.168.201.25@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788666208.438235:0:6651:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp t0 exp 0000000000000000 cur 315 last 0 00000020:00000080:2.0:1788666208.438289:0:6651:0:(genops.c:1385:class_connect()) connect: client 0911d461-5865-4ef7-8c3e-012fc04add58, cookie 0x96bbe788361e9f43 00002000:00100000:2.0:1788666208.438304:0:6651:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0911d461-5865-4ef7-8c3e-012fc04add58/ffff8ab2bc3c2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788666208.438332:0:6651:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788666208.438727:0:6651:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788666208.438755:0:6651:0:(import.c:65:import_set_state_nolock()) ffff8ab2bc3c4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788666208.438816:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2357:x1875552173596672:12345-192.168.201.25@tcp:8:lhsmtool_posix.0 Request processed in 641us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666208.438821:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:0.0:1788666208.441220:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666208.441424:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173596800 00000100:00100000:3.0:1788666208.441440:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173596800 00000100:00100000:3.0:1788666208.441545:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00100000:3.0:1788666208.441558:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+6:0:x1875552173596800:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788666208.441959:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788666208.485111:0:6678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0911d461-5865-4ef7-8c3e-012fc04add58 00000001:00080000:1.0:1788666208.485133:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:3.0:1788666208.485708:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+5:0:x1875552173596800:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 44143us (44501us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788666208.485726:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00100000:2.0:1788666208.503637:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666208.503817:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173597056 00000100:00100000:3.0:1788666208.503840:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173597056 00000100:00100000:3.0:1788666208.503902:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:3.0:1788666208.503913:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+56:10472:x1875552173597056:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788666208.504237:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+57:10472:x1875552173597056:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 326us (611us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788666208.504246:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:0.0:1788666208.506813:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666208.506899:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173597312 00000100:00100000:1.0:1788666208.506910:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173597312 00000100:00100000:1.0:1788666208.506972:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 77 00000100:00100000:1.0:1788666208.506982:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+57:10472:x1875552173597312:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788666208.507147:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+57:10472:x1875552173597312:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 156us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666208.507156:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 77 00000100:00100000:3.0:1788666208.523836:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666208.524007:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173597440 00000100:00100000:3.0:1788666208.524019:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173597440 00000100:00100000:3.0:1788666208.524078:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 78 00000100:00100000:3.0:1788666208.524088:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+57:10472:x1875552173597440:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788666208.524117:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666208.524153:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d4299b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.524438:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9f51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.524458:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9f51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.524475:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9f51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666208.524670:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788666208.524696:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9f51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.524740:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361e9f4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4299b expref: 59 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.524775:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9f51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4299b expref: 58 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.524787:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab2908f2200) 00010000:00010000:3.0:1788666208.524791:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788666208.524796:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814ffc00, rc 0) 00000100:00100000:3.0:1788666208.524891:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae508380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+58:10472:x1875552173597440:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 804us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666208.524901:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 78 00000100:00100000:0.0:1788666208.537512:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666208.538442:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173597568 00000100:00100000:2.0:1788666208.538459:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173597568 00000100:00100000:2.0:1788666208.538554:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:2.0:1788666208.538571:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+5:2363:x1875552173597568:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788666208.538626:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666208.538651:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361e9f58 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d429a2 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788666208.538689:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ce160, blocks: 0x1 00010000:00010000:2.0:1788666208.538722:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=315s v=(0 0) 00010000:00010000:2.0:1788666208.538728:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666208.538741:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361e9f58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429a2 expref: 6 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.538767:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361e9f58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429a2 expref: 6 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.538798:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f3e00, rc 0) 00000100:00100000:2.0:1788666208.538920:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173597568:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 353us (1422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666208.538928:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:3.0:1788666208.544230:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666208.544330:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173597824 00000100:00100000:1.0:1788666208.544348:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173597824 00000100:00100000:1.0:1788666208.544427:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:1.0:1788666208.544440:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+58:10472:x1875552173597824:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788666208.544623:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae50bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+58:10472:x1875552173597824:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 184us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666208.544631:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:1.0:1788666208.548505:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666208.548640:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173597952 00000100:00100000:2.0:1788666208.548654:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173597952 00000100:00100000:2.0:1788666208.548739:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:2.0:1788666208.548752:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:10472:x1875552173597952:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788666208.548784:0:6649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666208.548815:0:6649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361e9f5f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d429a9 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.548866:0:6649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361e9f58 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429a2 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.548876:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666208.548882:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666208.548889:0:6649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361e9f5f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429a9 expref: 7 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.548941:0:6649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361e9f58 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429a2 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.548956:0:6649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361e9f58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429a2 expref: 7 pid: 8429 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666208.548989:0:6649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1e06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6649:1875552186205696:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788666208.549103:0:6649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2ae4d1d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788666208.556666:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666208.556735:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173598080 00000100:00100000:1.0:1788666208.556746:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173598080 00010000:00010000:1.0:1788666208.556799:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361e9f58 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429a2 expref: 8 pid: 8429 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666208.556846:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:1.0:1788666208.556861:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a096d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+8:2364:x1875552173598080:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666208.556879:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666208.556908:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361e9f58 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429a2 expref: 8 pid: 8429 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666208.556922:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361e9f58 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429a2 expref: 8 pid: 8429 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666208.556957:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666208.556962:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666208.556969:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361e9f5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429a9 expref: 8 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666208.556976:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361e9f5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429a9 expref: 8 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666208.557013:0:5794:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361e9f5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429a9 expref: 8 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666208.557025:0:5794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2905edf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5794:1875552186205824:192.168.201.25@tcp:105: 00000100:00100000:1.0:1788666208.557102:0:5794:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bf992540 going to sleep for 11 seconds 00010000:00010000:2.0:1788666208.557316:0:6649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361e9f58 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429a2 expref: 8 pid: 8429 timeout: 415 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666208.557332:0:6649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1e06680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6649:1875552186205696:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666208.557357:0:6649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361e9f5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429a9 expref: 7 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.557368:0:6649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2c00, rc 0) 00000100:00100000:2.0:1788666208.557410:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905ef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+7:10472:x1875552173597952:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 8661us (8922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666208.557418:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:2.0:1788666208.567285:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666208.567370:0:5794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2905edf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5794:1875552186205824:192.168.201.25@tcp:105: 00010000:00010000:1.0:1788666208.567402:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666208.567465:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a096d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173598080:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 10606us (10807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666208.567483:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:3.0:1788666208.571771:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173598208 00000100:00100000:3.0:1788666208.571794:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173598208 00002000:00100000:3.0:1788666208.571861:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8ab2c1e06680 x1875552173598208/t0(0) o4->0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp:249/0 lens 504/0 e 0 to 0 dl 1788666219 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788666208.571871:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab2c1e06680 with x1875552173598208 ext(0->8) 00002000:00010000:3.0:1788666208.571879:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab2c1e06680 00000100:00100000:3.0:1788666208.571913:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:3.0:1788666208.571921:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173598208:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788666208.572665:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0911d461-5865-4ef7-8c3e-012fc04add58+8:2364:x1875552173598208:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 Request processed in 742us (5389us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788666208.572671:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00002000:00100000:3.0:1788666208.572678:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8ab2c1e06680 x1875552173598208/t4294967302(0) o4->0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp:249/0 lens 504/448 e 0 to 0 dl 1788666219 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788666208.572692:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab2c1e06680 with x1875552173598208 ext(0->8) 00002000:00010000:3.0:1788666208.572696:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab2c1e06680 00000100:00100000:2.0:1788666208.581934:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666208.587300:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173598336 00000100:00100000:0.0:1788666208.587326:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173598336 00000100:00100000:2.0:1788666208.588173:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 80 00000100:00100000:2.0:1788666208.588186:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+58:10472:x1875552173598336:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 00000040:00080000:0.0:1788666208.661838:0:11966:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788666208.661848:0:11966:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788666208.661886:0:11966:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788666208.661894:0:11966:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1788666208.683980:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:3.0:1788666208.684019:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:3.0:1788666208.684116:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788666208.684155:0:5830:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab181ab2180 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788666208.684161:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab2c1e0ba00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab181ab29c0 00000020:00080000:3.0:1788666208.684165:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab2c1e0b600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab2b457b800 00000001:00080000:3.0:1788666208.684197:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1788666208.684206:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788666208.684355:0:5841:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788666208.684515:0:5841:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788666208.687038:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186206080:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788666208.687105:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e05500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+13:10472:x1875552173598336:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 Request processed in 98918us (105178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666208.687111:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666208.687118:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 80 00000100:00100000:0.0:1788666208.687184:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186205952:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788666208.687476:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666208.687639:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186206080 00000100:00100000:3.0:1788666208.687650:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186206080 00000100:00100000:3.0:1788666208.687697:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186205952 00000100:00100000:3.0:1788666208.687701:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186205952 00000100:00100000:0.0:1788666208.687720:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788666208.687733:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186206080:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788666208.687736:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788666208.687742:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3275:x1875552186205952:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788666208.687777:0:6651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1788666208.687821:0:6651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9ce15d, atime: 0x6a9ce15d, ctime: 0x6a9ce15d, blocks: 0x1 00010000:00010000:3.0:1788666208.687830:0:6651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361e9f66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.687851:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=315s v=(0 0) 00010000:00010000:3.0:1788666208.687856:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666208.687864:0:6651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361e9f66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.687897:0:6651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361e9f66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.687909:0:6651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361e9f66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.687917:0:6651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361e9f66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.687937:0:6651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788666208.687977:0:6650:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788666208.687981:0:6650:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788666208 00002000:00010000:0.0:1788666208.687983:0:6650:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788666208.687985:0:6650:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788666208 -> 1788666208 00002000:00010000:0.0:1788666208.687987:0:6650:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788666208.688028:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3275:x1875552186206080:12345-0@lo:2:osp-syn-0-0.0 Request processed in 299us (916us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788666208.688035:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1788666208.688059:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666208.688065:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361e9f66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666208.688076:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff200 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:0.0:1788666208.688080:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361e9f66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666208.688090:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361e9f66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666208.688109:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361e9f66 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666208.688186:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361e9f66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666208.688425:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666208.688428:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666208.688434:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788666208.688471:0:3275:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab2ae509c00/2, rc 0, transno 4294967303 00000100:00100000:0.0:1788666208.688478:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186206080:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788666208.688647:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3275:x1875552186205952:12345-0@lo:6:osp-syn-1-0.0 Request processed in 905us (1170us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788666208.688655:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788666208.688673:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788666208.688673:0:3275:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab2aea1ed80/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788666208.688679:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186205952:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788666208.693804:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666208.696873:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173598464 00000100:00100000:1.0:1788666208.696907:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173598464 00000100:00100000:1.0:1788666208.697002:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:1.0:1788666208.697018:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+8:2364:x1875552173598464:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788666208.867903:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1788666208.867947:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1788666208.868425:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae508000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173598464:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 Request processed in 171404us (174628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666208.868466:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:1.0:1788666208.886939:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666208.893263:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173598720 00000100:00100000:2.0:1788666208.893289:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173598720 00000100:00100000:3.0:1788666208.894174:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 81 00000100:00100000:3.0:1788666208.894190:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+13:10472:x1875552173598720:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788666208.894262:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666208.894309:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9f51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4299b expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.894338:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab2908f2200) 00010000:00010000:3.0:1788666208.894345:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788666208.894390:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9f6d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.894675:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9f6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.894690:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9f6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788666208.894993:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000450f052f reply state 000000004f273c9d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9f6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666208.895004:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788666208.895168:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+14:10472:x1875552173598720:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 976us (8238us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788666208.895179:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 81 00010000:00010000:2.0:1788666208.909945:0:3261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9f6d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.909963:0:3261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9f6d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.909971:0:3261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9f6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.909977:0:3261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814fe600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666208.909982:0:3261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9f6d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.909989:0:3261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9f6d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.910007:0:3261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab2908f2200) 00010000:00010000:2.0:1788666208.910010:0:3261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666208.910015:0:3261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9f6d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.910033:0:3261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361e9f6d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666208.915225:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666208.916718:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173598848 00000100:00100000:0.0:1788666208.916742:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173598848 00000100:00100000:0.0:1788666208.920732:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:0.0:1788666208.920756:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae22c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+6:2361:x1875552173598848:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788666208.921036:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788666208.921040:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788666208 -> 1788666207 00002000:00010000:0.0:1788666208.921043:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788666205 00002000:00010000:0.0:1788666208.921046:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788666208 -> 1788666207 00002000:00010000:0.0:1788666208.921048:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788666208.921146:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae22c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+7:2361:x1875552173598848:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 400us (5933us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788666208.921154:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:0.0:1788666208.930776:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666208.937170:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173599104 00000100:00100000:3.0:1788666208.937196:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173599104 00000100:00100000:2.0:1788666208.942256:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 82 00000100:00100000:2.0:1788666208.942273:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+13:10472:x1875552173599104:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788666208.942355:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9f74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.942392:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361e9f2e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4298d expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.942402:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9f74 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.942444:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361e9f2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4298d expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.942459:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361e9f2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4298d expref: 13 pid: 5810 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666208.942477:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1e06300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875552186206208:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788666208.942601:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab282bcbb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788666208.945902:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666208.945941:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173599232 00000100:00100000:3.0:1788666208.945953:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173599232 00010000:00010000:3.0:1788666208.946003:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361e9f2e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4298d expref: 14 pid: 5810 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666208.946046:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:3.0:1788666208.946058:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae508e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+14:2364:x1875552173599232:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666208.946077:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666208.946087:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361e9f2e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4298d expref: 14 pid: 5810 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.946103:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361e9f2e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4298d expref: 14 pid: 5810 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.946421:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab2908f2200) 00010000:00010000:3.0:1788666208.946427:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9f74 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.946495:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9f74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.947670:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9f74 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.947704:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666208.947798:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae508e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+14:2364:x1875552173599232:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 1735us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666208.947810:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 43 00010000:00010000:3.0:1788666208.951855:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361e9f2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d4298d expref: 13 pid: 5810 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666208.951895:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1e06300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875552186206208:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788666208.951936:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9f74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.951949:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9f74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.951955:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9f74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.951994:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9f74 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.952016:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9f74 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.952025:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9f74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.952031:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666208.952037:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9f74 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.952046:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9f74 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.952072:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab2908f2200) 00010000:00010000:3.0:1788666208.952076:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788666208.952082:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9f74 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.952089:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361e9f74 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666208.952221:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+12:10472:x1875552173599104:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 Request processed in 9952us (21453us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788666208.952232:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 82 00000100:00100000:3.0:1788666208.958167:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666208.958300:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173599360 00000100:00100000:1.0:1788666208.958314:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173599360 00000100:00100000:1.0:1788666208.958397:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:1.0:1788666208.958411:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173599360:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788666208.958482:0:6649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db774d59/0x96bbe788361e9f7b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666208.958518:0:6649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361e9f5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429a9 expref: 7 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666208.958529:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666208.958535:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788666208.958540:0:6649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db774d59/0x96bbe788361e9f7b lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666208.958613:0:6649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361e9f5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429a9 expref: 7 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666208.958643:0:6649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361e9f5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429a9 expref: 7 pid: 6649 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666208.958662:0:6649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2905ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6649:1875552186206336:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788666208.958773:0:6649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28a9e5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788666208.968544:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666208.970904:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173599488 00000100:00100000:2.0:1788666208.970928:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173599488 00010000:00010000:2.0:1788666208.970995:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361e9f5f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429a9 expref: 8 pid: 6649 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666208.971052:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:2.0:1788666208.971066:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+8:2363:x1875552173599488:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788666208.971091:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666208.971215:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361e9f5f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429a9 expref: 8 pid: 6649 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.971245:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361e9f5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429a9 expref: 8 pid: 6649 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.971280:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788666208.971286:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788666208.971293:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000db774d59/0x96bbe788361e9f7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.971305:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000db774d59/0x96bbe788361e9f7b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.971330:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666208.971413:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+8:2363:x1875552173599488:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 350us (2885us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666208.971423:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 44 00010000:00010000:2.0:1788666208.972237:0:6649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361e9f5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429a9 expref: 7 pid: 6649 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666208.972260:0:6649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2905ee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6649:1875552186206336:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666208.972292:0:6649:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000db774d59/0x96bbe788361e9f7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.972307:0:6649:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000db774d59/0x96bbe788361e9f7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.972336:0:6649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000db774d59/0x96bbe788361e9f7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.972377:0:6649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000db774d59/0x96bbe788361e9f7b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.972388:0:6649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000db774d59/0x96bbe788361e9f7b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.972397:0:6649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000db774d59/0x96bbe788361e9f7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.972405:0:6649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855400 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666208.972411:0:6649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000db774d59/0x96bbe788361e9f7b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.972420:0:6649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000db774d59/0x96bbe788361e9f7b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.972618:0:6649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000db774d59/0x96bbe788361e9f7b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.972628:0:6649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000db774d59/0x96bbe788361e9f7b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666208.972729:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173599360:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 Request processed in 14321us (14575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666208.972739:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:3.0:1788666208.980731:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666208.980780:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173599744 00000100:00100000:2.0:1788666208.980800:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173599744 00000100:00100000:2.0:1788666208.980893:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 83 00000100:00100000:2.0:1788666208.980907:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+12:10472:x1875552173599744:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788666208.981026:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9f82 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.981052:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9f82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.981069:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9f82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.983384:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9f89 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.984879:0:7132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9f3c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42994 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.984902:0:7132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9f89 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.984957:0:7132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9f3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42994 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.985076:0:7132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9f3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42994 expref: 13 pid: 5808 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666208.985094:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1e06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186206464:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788666208.985217:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab282bcb180 going to sleep for 11 seconds 00000100:00100000:3.0:1788666208.989056:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666208.989258:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173599872 00000100:00100000:1.0:1788666208.989271:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173599872 00010000:00010000:1.0:1788666208.989326:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9f3c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42994 expref: 14 pid: 5808 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666208.989603:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:1.0:1788666208.989618:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+14:2363:x1875552173599872:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666208.989637:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666208.989647:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9f3c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42994 expref: 14 pid: 5808 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666208.989662:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9f3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42994 expref: 14 pid: 5808 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666208.989687:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab2908f2200) 00010000:00010000:1.0:1788666208.989693:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9f89 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666208.989705:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9f89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666208.989725:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9f89 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666208.989753:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666208.989839:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae50aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+14:2363:x1875552173599872:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 225us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666208.989846:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 45 00010000:00010000:2.0:1788666208.989987:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361e9f3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42994 expref: 13 pid: 5808 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666208.990005:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1e06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186206464:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666208.990025:0:7132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9f89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.990035:0:7132:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9f89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666208.990042:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9f89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788666208.990729:0:7132:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1788666208.990895:0:7132:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1788666208.990944:0:7132:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1788666208.991031:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1e06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7132:1875552186206592:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788666208.991094:0:7132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666208.991181:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab288577cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788666208.991197:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186206592 00000100:00100000:3.0:1788666208.991205:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186206592 00000100:00100000:3.0:1788666208.991257:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788666208.991267:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7132:x1875552186206592:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788666208.991361:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e07800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7132:x1875552186206592:12345-0@lo:1000:mdt00_003.0 Request processed in 95us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666208.991384:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788666208.992364:0:7132:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788666208.992373:0:7132:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab2ae509c00, transno 4294967303 00000100:00100000:2.0:1788666208.992394:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1e06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7132:1875552186206592:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788666208.995283:0:7132:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1788666208.996560:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae509c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7132:1875552186206720:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788666208.996681:0:7132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666208.996717:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2980efb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788666208.997081:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186206720 00000100:00100000:1.0:1788666208.997091:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186206720 00000100:00100000:1.0:1788666208.997162:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788666208.997172:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7132:x1875552186206720:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788666208.997445:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae50b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7132:x1875552186206720:12345-0@lo:1000:mdt00_003.0 Request processed in 275us (764us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788666208.997453:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788666208.997637:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae509c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7132:1875552186206720:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788666208.997681:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9f89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.997691:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9f89 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.997699:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9f89 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.997705:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666208.997710:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9f89 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.997719:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9f89 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.997740:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab2908f2200) 00010000:00010000:3.0:1788666208.997743:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788666208.997749:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9f89 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.997768:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9f89 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.997807:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9eb7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.997814:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9eb7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.998294:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9eb7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.998300:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666208.998303:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9eb7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.998309:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9eb7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.998319:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2a088ef00) 00010000:00010000:3.0:1788666208.998321:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788666208.998325:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9eb7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.998330:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9eb7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.998608:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9f90 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.998629:0:7132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9ed3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42978 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.998647:0:7132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9f90 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.998686:0:7132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42978 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666208.998700:0:7132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9ed3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42978 expref: 16 pid: 5809 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666208.998714:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186206848:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788666208.998803:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2980eff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788666209.008175:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666209.008175:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9d9500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186206848:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788666209.008204:0:7132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9f90 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666209.008230:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173600000 00000100:00100000:2.0:1788666209.008237:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173600000 00010000:00010000:2.0:1788666209.008273:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9ed3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42978 expref: 17 pid: 5809 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666209.008312:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:2.0:1788666209.008322:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+17:2363:x1875552173600000:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788666209.008338:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666209.008345:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9ed3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42978 expref: 17 pid: 5809 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666209.008353:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9ed3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42978 expref: 17 pid: 5809 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666209.008383:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361e9ed3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42978 expref: 17 pid: 5809 timeout: 415 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666209.008398:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2a088ef00) 00010000:00010000:2.0:1788666209.008402:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9f90 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666209.008412:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9f90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666209.008419:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9f90 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666209.008444:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788666209.008515:0:7132:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9f90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666209.008523:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9f90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666209.008534:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9f90 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666209.008541:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9f90 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666209.008562:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9f90 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666209.008568:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666209.008572:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9f90 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666209.008602:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9f90 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666209.008613:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2a088ef00) 00010000:00010000:1.0:1788666209.008615:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666209.008619:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9f90 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666209.008625:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361e9f90 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666209.008636:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9f82 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666209.008642:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9f82 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666209.008648:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9f82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666209.008653:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666209.008655:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9f82 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666209.008671:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9f82 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666209.008680:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2a088ef00) 00010000:00010000:1.0:1788666209.008682:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788666209.008685:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9f82 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666209.008691:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9f82 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788666209.009047:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788666209.009053:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788666209.009080:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788666209.009086:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788666209.010187:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+16:2363:x1875552173600000:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 1856us (2010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666209.010222:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:1.0:1788666209.010300:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae508000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+15:10472:x1875552173599744:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 29395us (29583us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1788666209.010310:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 83 00000020:00080000:1.0:1788666209.010315:0:7132:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788666209.014195:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666209.014512:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173600256 00000100:00100000:0.0:1788666209.014524:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173600256 00000100:00100000:0.0:1788666209.014610:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:1.0:1788666209.014617:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1788666209.014622:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+15:10472:x1875552173600256:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788666209.014627:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000004:00080000:0.0:1788666209.015472:0:5812:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788666209.015628:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1788666209.015689:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361e9f97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666209.015706:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361e9f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666209.015718:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361e9f97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666209.015727:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361e9f97 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666209.015734:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361e9f97 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666209.015742:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361e9f97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666209.015776:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788666209.015901:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+17:10472:x1875552173600256:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 1279us (1721us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788666209.015910:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00000020:00080000:0.0:1788666209.015916:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788666209.015979:0:7593:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666209.015987:0:7593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361e9f97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666209.015993:0:7593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144aa00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:1.0:1788666209.015997:0:7593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361e9f97 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666209.016005:0:7593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361e9f97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666209.016026:0:7593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8ab290a48300) 00010000:00010000:1.0:1788666209.016029:0:7593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788666209.016034:0:7593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361e9f97 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666209.016040:0:7593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361e9f97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666209.016060:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666209.016062:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666209.016064:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666209.292967:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666209.308930:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666209.308984:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666209.309020:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666209.309031:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173600384 00000100:00100000:1.0:1788666209.309043:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173600384 00000100:00100000:0.0:1788666209.309074:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173600640 00000100:00100000:0.0:1788666209.309078:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173600640 00000100:00100000:1.0:1788666209.309143:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 290 00000100:00100000:0.0:1788666209.309143:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 139 00000100:00100000:1.0:1788666209.309154:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173600384:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666209.309154:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173600640:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666209.309244:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173600640:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 90us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666209.309267:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 139 00000100:00080000:0.0:1788666209.309290:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666209.309738:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173600512 00000100:00100000:3.0:1788666209.309747:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173600512 00000100:00100000:3.0:1788666209.309798:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 78 00000100:00100000:3.0:1788666209.309807:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+7:2364:x1875552173600512:12345-192.168.201.25@tcp:400:kworker.0 00000100:00080000:2.0:1788666209.316091:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788666209.320193:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173600384:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 11008us (11238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666209.320217:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 290 00000100:00100000:2.0:1788666209.347122:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+7:2364:x1875552173600512:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 37298us (38081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666209.347152:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 78 00000001:00080000:2.0:1788666210.277966:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:2.0:1788666210.277986:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:2.0:1788666210.277995:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:0.0:1788666210.316299:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666210.699215:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186207104:0@lo:400:kworker.0 00000100:00100000:2.0:1788666210.699315:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666210.699533:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186207616:0@lo:400:kworker.0 00000100:00100000:2.0:1788666210.699567:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666210.699633:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666210.699640:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1e05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186207232:0@lo:400:kworker.0 00000100:00100000:2.0:1788666210.699664:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666210.699719:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186207104 00000100:00100000:2.0:1788666210.699733:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186207104 00000100:00100000:2.0:1788666210.700460:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186207232 00000100:00100000:2.0:1788666210.700468:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186207232 00000100:00100000:2.0:1788666210.700522:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788666210.700532:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186207104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666210.700799:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186206976:0@lo:400:kworker.0 00000100:00100000:1.0:1788666210.700911:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788666210.700922:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186207232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666210.702221:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186207360:0@lo:400:kworker.0 00000100:00100000:3.0:1788666210.706732:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666210.706840:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1e06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186207488:0@lo:400:kworker.0 00000100:00100000:3.0:1788666210.706909:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666210.706986:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186207616 00000100:00100000:3.0:1788666210.706998:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186207616 00000100:00100000:3.0:1788666210.707075:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788666210.707086:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186207616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666210.707194:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186207616:12345-0@lo:400:kworker.0 Request processed in 110us (7626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666210.707203:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788666210.707242:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788666210.707250:0:5808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1788666210.707269:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186206976 00000100:00100000:3.0:1788666210.707272:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186206976 00000100:00100000:3.0:1788666210.707300:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788666210.707306:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186206976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666210.707356:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186206976:12345-0@lo:400:kworker.0 Request processed in 50us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666210.707371:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788666210.707758:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:3.0:1788666210.707766:0:3277:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:3.0:1788666210.707799:0:3277:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab2aea1ed80, transno 4294967301 00000100:00100000:3.0:1788666210.707822:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1e04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186207616:0@lo:400:kworker.0 00000100:00100000:3.0:1788666210.707852:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1e06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186206976:0@lo:400:kworker.0 00000100:00100000:3.0:1788666210.707906:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186207488 00000100:00100000:3.0:1788666210.707913:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186207488 00000100:00100000:3.0:1788666210.707947:0:5808:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1788666210.707956:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788666210.707962:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186207488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666210.708013:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186207488:12345-0@lo:400:kworker.0 Request processed in 50us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666210.708019:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788666210.708051:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1e06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186207488:0@lo:400:kworker.0 00000100:00100000:1.0:1788666210.709292:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186207232:12345-0@lo:400:kworker.0 Request processed in 8362us (9615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666210.709307:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788666210.715429:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1e05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186207232:0@lo:400:kworker.0 00000100:00080000:1.0:1788666210.716123:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788666210.716133:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666210.716302:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186207104:12345-0@lo:400:kworker.0 Request processed in 15765us (16980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666210.716321:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788666210.720543:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1e07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186207104:0@lo:400:kworker.0 00000100:00100000:0.0:1788666210.721474:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666210.721631:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186207360 00000100:00100000:3.0:1788666210.721644:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186207360 00000100:00100000:3.0:1788666210.721725:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788666210.721738:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3275:x1875552186207360:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788666210.722028:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788666210.722070:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3275:x1875552186207360:12345-0@lo:400:kworker.0 Request processed in 334us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666210.722079:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788666210.730908:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1e04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186207360:0@lo:400:kworker.0 00000040:00080000:0.0:1788666211.054831:0:12020:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788666211.054845:0:12020:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788666211.054884:0:12020:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788666211.054894:0:12020:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788666211.212089:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186207744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788666211.212180:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666211.212262:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186207744 00000100:00100000:0.0:1788666211.212270:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186207744 00000100:00100000:0.0:1788666211.212318:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788666211.212328:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186207744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788666211.212367:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666211.212412:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186207744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666211.212419:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788666211.212483:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186207744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788666211.257343:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666211.257744:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173600896 00000100:00100000:3.0:1788666211.257757:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173600896 00000100:00100000:3.0:1788666211.257899:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 84 00000100:00100000:3.0:1788666211.257911:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+17:10491:x1875552173600896:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1788666211.257944:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666211.257968:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9f9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d429b0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.258296:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9fa5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.258313:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9fa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.258328:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9fa5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666211.258340:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788666211.258789:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9f9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429b0 expref: 20 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.258834:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9fa5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429b0 expref: 19 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.258843:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:3.0:1788666211.258847:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788666211.258851:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814ff800, rc 0) 00000100:00100000:3.0:1788666211.260260:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+19:10491:x1875552173600896:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 2341us (2926us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788666211.260276:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 84 00000100:00080000:1.0:1788666211.265160:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666211.271605:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666211.272633:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173601024 00000100:00100000:3.0:1788666211.272647:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173601024 00000100:00100000:3.0:1788666211.272734:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 85 00000100:00100000:3.0:1788666211.272746:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+19:10491:x1875552173601024:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:3.0:1788666211.272843:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9fb3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.272867:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9fb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.272883:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9fb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273225:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9fba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273252:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9fba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273261:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9fba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273558:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9fc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273568:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273575:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788666211.273663:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273679:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9fb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273686:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9fb3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273694:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9fb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273701:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814fe400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666211.273706:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9fb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273715:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9fb3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273738:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:2.0:1788666211.273741:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666211.273746:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9fb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273753:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9fb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273767:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9fba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273772:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9fba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273789:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9fba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273795:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666211.273797:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9fba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273803:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9fba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273811:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab2a088e700) 00010000:00010000:2.0:1788666211.273814:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666211.273816:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9fba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273821:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9fba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273849:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9fc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273855:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9fc1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273861:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273866:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666211.273869:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9fc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273875:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9fc1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.273882:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2a088e900) 00010000:00010000:2.0:1788666211.273884:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666211.274273:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9fc1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.274282:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9fc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666211.274407:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+19:10491:x1875552173601024:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 1659us (2830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666211.274418:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 85 00010000:00010000:1.0:1788666211.348753:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666211.383495:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666211.383959:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173601280 00000100:00100000:2.0:1788666211.383978:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173601280 00000100:00100000:2.0:1788666211.384055:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 86 00000100:00100000:2.0:1788666211.384375:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+19:10494:x1875552173601280:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666211.384403:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666211.384430:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9fc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d429b7 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.384523:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9fcf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.384540:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9fcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.384552:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9fcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.384571:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9fd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.384807:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.384817:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.389851:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9fdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.389877:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9fdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.389981:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9fdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666211.389996:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788666211.390279:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9fcf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.390289:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9fcf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.390298:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9fcf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.390307:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666211.390312:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9fcf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.390321:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9fcf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.390340:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:3.0:1788666211.390344:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666211.390350:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9fcf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.390357:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361e9fcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.390377:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.390383:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9fd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.390395:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.390401:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666211.390403:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.390409:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9fd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.390417:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab2a088e900) 00010000:00010000:3.0:1788666211.390420:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666211.390422:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9fd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.390428:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361e9fd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.390499:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361e9fc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429b7 expref: 22 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.390514:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9fdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429b7 expref: 21 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.390522:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72600) 00010000:00010000:3.0:1788666211.390524:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788666211.390527:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814ffc00, rc 0) 00000100:00100000:3.0:1788666211.390969:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+21:10494:x1875552173601280:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 6594us (7483us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788666211.390991:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 86 00000100:00100000:0.0:1788666211.400844:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666211.401019:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173601408 00000100:00100000:3.0:1788666211.401034:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173601408 00000100:00100000:3.0:1788666211.401138:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 87 00000100:00100000:3.0:1788666211.401150:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+21:10494:x1875552173601408:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:3.0:1788666211.401258:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9feb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.401283:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.401299:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.401336:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.401345:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9feb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.401353:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9feb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.401361:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814fe400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666211.401367:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9feb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.401376:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9feb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.401391:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72600) 00010000:00010000:3.0:1788666211.401403:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788666211.401410:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9feb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.401417:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361e9feb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666211.401531:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+21:10494:x1875552173601408:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 383us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666211.401539:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 87 00000100:00100000:0.0:1788666211.409713:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666211.409937:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173601664 00000100:00100000:3.0:1788666211.409950:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173601664 00000100:00100000:3.0:1788666211.410035:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:3.0:1788666211.410050:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28f367050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+21:10494:x1875552173601664:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1788666211.410415:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28f367050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+22:10494:x1875552173601664:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 368us (718us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788666211.410424:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:1.0:1788666211.478396:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666211.478641:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173601920 00000100:00100000:2.0:1788666211.478657:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173601920 00000100:00100000:2.0:1788666211.478745:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 88 00000100:00100000:2.0:1788666211.478758:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+22:10015:x1875552173601920:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:2.0:1788666211.478807:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666211.478840:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9ff2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d429be expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.479011:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9ff9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.479031:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9fdd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429b7 expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.479043:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9ff9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.479109:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9fdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429b7 expref: 23 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.479128:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9fdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429b7 expref: 23 pid: 5809 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666211.479147:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1e05f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5810:1875552186207872:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788666211.479324:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2c1b6b600 going to sleep for 11 seconds 00000100:00100000:2.0:1788666211.483476:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1e05f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5810:1875552186207872:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666211.483532:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9ff9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666211.488026:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666211.490675:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173602048 00000100:00100000:3.0:1788666211.490700:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173602048 00010000:00010000:2.0:1788666211.490939:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9fdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429b7 expref: 24 pid: 5809 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666211.491018:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:2.0:1788666211.491031:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+24:2363:x1875552173602048:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788666211.491082:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666211.491102:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9fdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429b7 expref: 24 pid: 5809 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.491348:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9fdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429b7 expref: 24 pid: 5809 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.491373:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361e9fdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429b7 expref: 24 pid: 5809 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.491392:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72600) 00010000:00010000:2.0:1788666211.491398:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9ff9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.491408:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9ff9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.491415:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9ff9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.491574:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666211.491701:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+23:2363:x1875552173602048:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 671us (3690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666211.491712:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 47 00010000:00010000:3.0:1788666211.498575:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9ff9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.498755:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9ff9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666211.498787:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788666211.504932:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361e9ff2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429be expref: 24 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.504965:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9ff9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429be expref: 23 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.505536:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72600) 00010000:00010000:2.0:1788666211.505539:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788666211.505544:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2c00, rc 0) 00000100:00100000:2.0:1788666211.506301:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+23:10015:x1875552173601920:12345-192.168.201.25@tcp:101:bash.0 Request processed in 27532us (27910us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788666211.506319:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 88 00000100:00100000:1.0:1788666211.512026:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666211.512130:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173602304 00000100:00100000:3.0:1788666211.512143:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173602304 00000100:00100000:3.0:1788666211.512224:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 89 00000100:00100000:3.0:1788666211.512235:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+23:10015:x1875552173602304:12345-192.168.201.25@tcp:36:bash.0 00010000:00010000:0.0:1788666211.512905:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea007 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666211.512926:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea007 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666211.512939:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea007 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788666211.513010:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788666211.513039:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d849e44 reply state 00000000cf8ea6cd transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea007 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666211.513049:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788666211.513659:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788666211.513796:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+27:10015:x1875552173602304:12345-192.168.201.25@tcp:36:bash.0 Request processed in 1559us (1780us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788666211.513806:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 89 00000020:00080000:0.0:1788666211.513813:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788666211.518722:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea007 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.518752:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea007 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.518761:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea007 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.518769:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144b800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666211.518775:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea007 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.518783:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea007 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.518811:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72600) 00010000:00010000:3.0:1788666211.518827:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666211.518833:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea007 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.518842:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea007 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666211.518933:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666211.519576:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173602432 00000100:00100000:0.0:1788666211.519618:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173602432 00000100:00100000:3.0:1788666211.519866:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 90 00000100:00100000:3.0:1788666211.519880:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+26:10015:x1875552173602432:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1788666211.519913:0:12001:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666211.519936:0:12001:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea00e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d429c5 expref: -99 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.520045:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea00e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429c5 expref: 27 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.520060:0:12001:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea00e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429c5 expref: 27 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.520085:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72600) 00010000:00010000:3.0:1788666211.520098:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788666211.520102:0:12001:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814fe400, rc 0) 00000100:00100000:3.0:1788666211.520811:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+27:10015:x1875552173602432:12345-192.168.201.25@tcp:101:bash.0 Request processed in 928us (1879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666211.520822:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 90 00000100:00100000:2.0:1788666211.525291:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666211.525341:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173602560 00000100:00100000:3.0:1788666211.525416:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173602560 00000100:00080000:1.0:1788666211.525492:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788666211.525621:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 34 00000100:00100000:3.0:1788666211.525635:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+6:10015:x1875552173602560:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1788666211.525656:0:6650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666211.525687:0:6650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051a79005/0x96bbe788361ea015 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d429cc expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788666211.525735:0:6650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ce15f, atime: 0x6a9ce15d, ctime: 0x6a9ce15f, blocks: 0xb 00010000:00010000:3.0:1788666211.525830:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=318s v=(0 0) 00010000:00010000:3.0:1788666211.525836:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666211.525846:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051a79005/0x96bbe788361ea015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429cc expref: 7 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.525896:0:6650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000051a79005/0x96bbe788361ea015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429cc expref: 7 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.525912:0:6650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814ff400, rc 0) 00000100:00100000:3.0:1788666211.526075:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e05f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+7:10015:x1875552173602560:12345-192.168.201.25@tcp:101:bash.0 Request processed in 442us (797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666211.526082:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 34 00000100:00100000:1.0:1788666211.529661:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666211.529782:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173602688 00000100:00100000:2.0:1788666211.529798:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173602688 00002000:00010000:2.0:1788666211.529870:0:6654:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788666211.529875:0:6654:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab2905ef800 with x1875552173602688 ext(0->18446744073709551615) 00002000:00010000:2.0:1788666211.529887:0:6654:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab2905ef800. 00000100:00100000:2.0:1788666211.529934:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:2.0:1788666211.529945:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0911d461-5865-4ef7-8c3e-012fc04add58+7:2364:x1875552173602688:12345-192.168.201.25@tcp:10:bash.0 00002000:00010000:2.0:1788666211.530616:0:6654:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788666211.530621:0:6654:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788666207 -> 1788666211 00002000:00010000:2.0:1788666211.530624:0:6654:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788666205 -> 1788666205 00002000:00010000:2.0:1788666211.530626:0:6654:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788666207 -> 1788666211 00002000:00010000:2.0:1788666211.530627:0:6654:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788666211.530745:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0911d461-5865-4ef7-8c3e-012fc04add58+8:2364:x1875552173602688:12345-192.168.201.25@tcp:10:bash.0 Request processed in 798us (1089us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788666211.530756:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 1 00002000:00010000:2.0:1788666211.530760:0:6654:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:2.0:1788666211.530763:0:6654:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab2905ef800 with x1875552173602688 ext(0->18446744073709551615) 00002000:00010000:2.0:1788666211.530784:0:6654:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab2905ef800. 00000100:00100000:0.0:1788666211.630756:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666211.630892:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173602816 00000100:00100000:2.0:1788666211.630904:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173602816 00000100:00100000:2.0:1788666211.630995:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 91 00000100:00100000:2.0:1788666211.631008:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+27:10508:x1875552173602816:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:2.0:1788666211.631106:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea01c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631139:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea01c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631155:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea01c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631176:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea023 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631183:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea023 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631190:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea023 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631552:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea02a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631564:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea02a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631572:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea02a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788666211.631690:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea02a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631708:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea01c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631716:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea01c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631725:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea01c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631732:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2e00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666211.631739:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea01c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631749:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea01c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631766:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:2.0:1788666211.631771:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666211.631778:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea01c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631787:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea01c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631807:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea023 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631814:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea023 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631826:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea023 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631831:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666211.631834:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea023 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631841:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea023 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631851:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab2a088e700) 00010000:00010000:2.0:1788666211.631853:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666211.631856:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea023 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631863:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea023 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631889:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea02a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631898:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea02a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631904:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea02a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631909:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666211.631911:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea02a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631928:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea02a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631937:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72600) 00010000:00010000:2.0:1788666211.631940:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666211.631943:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea02a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666211.631949:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea02a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666211.632093:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+27:10508:x1875552173602816:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 1076us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666211.632102:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 91 00000100:00100000:3.0:1788666211.688857:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666211.689275:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173603072 00000100:00100000:0.0:1788666211.689292:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173603072 00000100:00100000:1.0:1788666211.689931:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 92 00000100:00100000:1.0:1788666211.689954:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+27:10511:x1875552173603072:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788666211.690158:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666211.690187:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea031 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d429d3 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.690285:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea038 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.690305:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea038 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.690317:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea038 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.690334:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea03f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.690340:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea03f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.690369:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea03f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.690892:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854c00/0x96bbe788361ea046 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.690903:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854c00/0x96bbe788361ea046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.690910:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854c00/0x96bbe788361ea046 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666211.690920:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788666211.691107:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea038 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.691116:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea038 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.691122:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea038 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.691128:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666211.691132:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea038 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.691140:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea038 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.691153:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:1.0:1788666211.691156:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666211.691167:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea038 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.691174:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea038 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.691188:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea03f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.691195:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea03f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.691200:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea03f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.691206:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855a00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666211.691208:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea03f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.691214:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea03f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.691222:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab2908f2800) 00010000:00010000:1.0:1788666211.691224:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666211.691226:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea03f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.691232:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea03f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.691278:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea031 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429d3 expref: 30 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.691305:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854c00/0x96bbe788361ea046 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429d3 expref: 29 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.691313:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72600) 00010000:00010000:1.0:1788666211.691315:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788666211.691318:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298854c00, rc 0) 00000100:00100000:1.0:1788666211.691724:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+29:10511:x1875552173603072:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1778us (2883us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1788666211.691734:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 92 00000100:00100000:0.0:1788666211.695140:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666211.695256:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173603200 00000100:00100000:3.0:1788666211.695272:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173603200 00000100:00100000:3.0:1788666211.695367:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 93 00000100:00100000:3.0:1788666211.695743:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+29:10511:x1875552173603200:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:3.0:1788666211.696282:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea054 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.696305:0:12001:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9ff9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429be expref: 29 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.696318:0:12001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea054 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.696371:0:12001:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9ff9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429be expref: 29 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.696878:0:12001:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9ff9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429be expref: 29 pid: 5810 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666211.696921:0:12001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9db480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12001:1875552186208000:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788666211.697157:0:12001:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab181ab2900 going to sleep for 11 seconds 00000100:00100000:0.0:1788666211.702311:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666211.702404:0:11980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173603456 00000100:00100000:1.0:1788666211.702419:0:11980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173603456 00000100:00100000:1.0:1788666211.702516:0:11980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:1.0:1788666211.702532:0:11980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+30:5601:x1875552173603456:12345-192.168.201.25@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788666211.703151:0:11980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+31:5601:x1875552173603456:12345-192.168.201.25@tcp:35:ldlm_bl.0 Request processed in 619us (852us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788666211.703163:0:11980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:3.0:1788666211.706706:0:12001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9db480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12001:1875552186208000:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788666211.706753:0:12001:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea054 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666211.711896:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666211.712015:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173603584 00000100:00100000:1.0:1788666211.712029:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173603584 00010000:00010000:1.0:1788666211.712093:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9ff9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429be expref: 31 pid: 5810 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666211.712139:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:1.0:1788666211.712153:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+31:2364:x1875552173603584:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666211.712178:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666211.712203:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9ff9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429be expref: 31 pid: 5810 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.712219:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9ff9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429be expref: 31 pid: 5810 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.712249:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361e9ff9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429be expref: 31 pid: 5810 timeout: 418 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.712273:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72600) 00010000:00010000:1.0:1788666211.712280:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea054 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.712291:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.712300:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea054 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.712335:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666211.712556:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+30:2364:x1875552173603584:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 405us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666211.712565:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 48 00010000:00010000:3.0:1788666211.713715:0:12001:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.713731:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.713772:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.713779:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea054 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.713787:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea054 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.713793:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff000 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666211.713799:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea054 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.713807:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea054 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.713828:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72600) 00010000:00010000:3.0:1788666211.713853:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788666211.713860:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea054 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.713867:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea054 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666211.713957:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+29:10511:x1875552173603200:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 18576us (18833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666211.713967:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 93 00000100:00100000:1.0:1788666211.726889:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666211.726996:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173603840 00000100:00100000:0.0:1788666211.727009:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173603840 00000100:00100000:0.0:1788666211.727077:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:0.0:1788666211.727099:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+29:10511:x1875552173603840:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:0.0:1788666211.727499:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+30:10511:x1875552173603840:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 411us (622us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788666211.727507:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:0.0:1788666211.891751:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666211.891913:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173604096 00000100:00100000:1.0:1788666211.891931:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173604096 00000100:00100000:1.0:1788666211.892018:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 94 00000100:00100000:1.0:1788666211.892030:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+30:10522:x1875552173604096:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:1.0:1788666211.892060:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666211.892121:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea05b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d429da expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.892243:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea062 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.892263:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.892280:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.892302:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea069 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.892308:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.892314:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.893273:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.893293:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.893304:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666211.893315:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788666211.894301:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.894345:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea062 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.894353:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.894361:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666211.894368:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.894385:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea062 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.894404:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:1.0:1788666211.894407:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666211.894413:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea062 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.894419:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea062 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.894679:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.894688:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea069 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.894695:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.894700:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666211.894712:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.894719:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea069 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.894727:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab2908f2800) 00010000:00010000:1.0:1788666211.894730:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666211.894734:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea069 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.894739:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea069 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.894829:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea05b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429da expref: 33 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.894845:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429da expref: 32 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.894852:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72600) 00010000:00010000:1.0:1788666211.894854:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788666211.894857:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855000, rc 0) 00000100:00100000:1.0:1788666211.894949:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+32:10522:x1875552173604096:12345-192.168.201.25@tcp:101:cat.0 Request processed in 2919us (3213us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788666211.894958:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 94 00000100:00100000:2.0:1788666211.906902:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666211.907213:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173604352 00000100:00100000:0.0:1788666211.907235:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173604352 00000100:00100000:0.0:1788666211.907314:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:0.0:1788666211.907325:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+32:10522:x1875552173604352:12345-192.168.201.25@tcp:35:cat.0 00000100:00100000:0.0:1788666211.908491:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+33:10522:x1875552173604352:12345-192.168.201.25@tcp:35:cat.0 Request processed in 1159us (1598us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788666211.908503:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:2.0:1788666211.934203:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666211.934306:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173604608 00000100:00100000:1.0:1788666211.934322:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173604608 00000100:00100000:1.0:1788666211.934395:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 95 00000100:00100000:1.0:1788666211.934405:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+33:10523:x1875552173604608:12345-192.168.201.25@tcp:36:rm.0 00010000:00010000:1.0:1788666211.934494:0:7132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788666211.934521:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea070 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429da expref: 33 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.934542:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854c00/0x96bbe788361ea046 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429d3 expref: 32 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.934555:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea00e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429c5 expref: 31 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.934566:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2b9e72600) 00010000:00010000:1.0:1788666211.934631:0:7132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788666211.934657:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea07e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.934674:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea07e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.934685:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea07e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.934700:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea085 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.934706:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.934712:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.935034:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea08c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.935045:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea08c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.935052:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea08c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788666211.935709:0:7132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1788666211.935721:0:7132:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 318644140393ns, next at 319644137099ns, rc = 0 00010000:00010000:1.0:1788666211.935788:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea093 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.935798:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea093 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.935806:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea093 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.935815:0:7132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea093 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.935822:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea093 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.935828:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea093 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.935863:0:7132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788666211.935888:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea08c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.935900:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea08c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.935907:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea08c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.935913:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666211.935917:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea08c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.935924:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea08c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.935934:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2908f2e00) 00010000:00010000:1.0:1788666211.935938:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788666211.935942:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea08c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.935947:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea08c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.935966:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea07e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.935971:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea07e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.935977:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea07e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.935981:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855a00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666211.935991:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea07e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.935997:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea07e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.936005:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:1.0:1788666211.936007:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666211.936010:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea07e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666211.936017:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea07e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788666211.936027:0:7132:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008045ff16 reply state 0000000060fafe86 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666211.936036:0:7132:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788666211.936145:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+32:10523:x1875552173604608:12345-192.168.201.25@tcp:36:rm.0 Request processed in 1737us (1949us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788666211.936154:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 95 00010000:00010000:3.0:1788666211.936873:0:7593:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666211.936884:0:7593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea093 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.936893:0:7593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855400 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666211.936897:0:7593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea093 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.936905:0:7593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea093 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.936916:0:7593:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8ab2908f2e00) 00010000:00010000:3.0:1788666211.936919:0:7593:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788666211.936923:0:7593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea093 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.936928:0:7593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea093 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.936943:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666211.936945:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666211.936946:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666211.941960:0:3261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea085 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.941990:0:3261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea085 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.941999:0:3261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea085 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.942005:0:3261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666211.942012:0:3261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea085 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.942021:0:3261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea085 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.942046:0:3261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab2908f2800) 00010000:00010000:3.0:1788666211.942051:0:3261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666211.942057:0:3261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea085 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666211.942065:0:3261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea085 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666212.009126:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666212.009211:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173604864 00000100:00100000:3.0:1788666212.009224:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173604864 00000100:00100000:3.0:1788666212.009303:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 96 00000100:00100000:3.0:1788666212.009317:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+31:10529:x1875552173604864:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1788666212.009359:0:12001:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666212.009390:0:12001:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea09a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d429e1 expref: -99 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.009621:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea0a1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.009637:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea0a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.009648:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea0a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.009663:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea0a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.009671:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea0a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.009678:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea0a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788666212.010387:0:12001:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788666212.010640:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea0af lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.010652:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea0af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.010661:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea0af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.010703:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea0a1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.010723:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea0a1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.010733:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea0a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.010740:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814fe600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666212.010747:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea0a1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.010756:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea0a1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.010778:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:3.0:1788666212.010783:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666212.010789:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea0a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.010795:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea0a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788666212.010817:0:12001:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009d9a813b reply state 00000000b0fb01ad transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea0a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666212.010828:0:12001:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788666212.010877:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea09a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429e1 expref: 34 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.010896:0:12001:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea0af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429e1 expref: 33 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.010918:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab2b9e72300) 00010000:00010000:3.0:1788666212.010922:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788666212.010924:0:12001:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814fe400, rc 0) 00000100:00100000:3.0:1788666212.011035:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+34:10529:x1875552173604864:12345-192.168.201.25@tcp:101:bash.0 Request processed in 1721us (1922us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788666212.011045:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 96 00010000:00010000:3.0:1788666212.016825:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea0a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.016854:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea0a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.016864:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea0a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.016872:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666212.016877:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea0a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.016886:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea0a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.016911:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab2b9e72100) 00010000:00010000:3.0:1788666212.016915:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666212.016920:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea0a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.016926:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea0a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666212.023915:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666212.024289:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173604992 00000100:00100000:1.0:1788666212.024301:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173604992 00000100:00100000:1.0:1788666212.024388:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00100000:1.0:1788666212.024399:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+5:2364:x1875552173604992:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788666212.024422:0:6651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666212.024460:0:6651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad08f882/0x96bbe788361ea0bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d429e8 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788666212.024492:0:6651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788666212.024532:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=318s v=(0 0) 00010000:00010000:1.0:1788666212.024536:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666212.024548:0:6651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad08f882/0x96bbe788361ea0bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429e8 expref: 6 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.024574:0:6651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ad08f882/0x96bbe788361ea0bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429e8 expref: 6 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.024621:0:6651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855a00, rc 0) 00000100:00100000:1.0:1788666212.024692:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173604992:12345-192.168.201.25@tcp:101:bash.0 Request processed in 295us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666212.024699:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00080000:2.0:1788666212.025170:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788666212.029296:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666212.029471:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173605120 00000100:00100000:3.0:1788666212.029487:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173605120 00000100:00100000:3.0:1788666212.029571:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:3.0:1788666212.029632:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:10529:x1875552173605120:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1788666212.029659:0:6649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666212.029683:0:6649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea0c4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d429ef expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.029736:0:6649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ad08f882/0x96bbe788361ea0bd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429e8 expref: 7 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.029746:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666212.029752:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666212.029759:0:6649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea0c4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429ef expref: 7 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.029812:0:6649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ad08f882/0x96bbe788361ea0bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429e8 expref: 7 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.029830:0:6649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ad08f882/0x96bbe788361ea0bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429e8 expref: 7 pid: 6651 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666212.029850:0:6649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6649:1875552186208128:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788666212.029987:0:6649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab181ab2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788666212.033853:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666212.033953:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173605248 00000100:00100000:1.0:1788666212.033966:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173605248 00010000:00010000:1.0:1788666212.034034:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ad08f882/0x96bbe788361ea0bd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429e8 expref: 8 pid: 6651 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666212.034121:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:1.0:1788666212.034133:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a096d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+8:2364:x1875552173605248:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666212.034152:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666212.034177:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ad08f882/0x96bbe788361ea0bd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429e8 expref: 8 pid: 6651 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.034193:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ad08f882/0x96bbe788361ea0bd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429e8 expref: 8 pid: 6651 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.034246:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666212.034251:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666212.034261:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea0c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429ef expref: 8 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.034272:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429ef expref: 8 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.034322:0:5795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429ef expref: 8 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666212.034419:0:5795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2905ed880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5795:1875552186208256:192.168.201.25@tcp:105: 00000100:00100000:1.0:1788666212.034676:0:5795:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab181165180 going to sleep for 11 seconds 00010000:00010000:3.0:1788666212.034774:0:6649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad08f882/0x96bbe788361ea0bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429e8 expref: 8 pid: 6651 timeout: 418 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666212.034801:0:6649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6649:1875552186208128:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788666212.034829:0:6649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429ef expref: 7 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.034840:0:6649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814ff200, rc 0) 00000100:00100000:3.0:1788666212.034873:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+7:10529:x1875552173605120:12345-192.168.201.25@tcp:101:bash.0 Request processed in 5292us (5595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666212.034881:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:0.0:1788666212.049206:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666212.049821:0:11980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173605504 00000100:00100000:3.0:1788666212.049837:0:11980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173605504 00000100:00100000:3.0:1788666212.049915:0:11980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:3.0:1788666212.049927:0:11980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+33:10529:x1875552173605504:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:3.0:1788666212.050875:0:11980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+34:10529:x1875552173605504:12345-192.168.201.25@tcp:35:bash.0 Request processed in 945us (1681us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1788666212.050885:0:11980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:1.0:1788666212.051033:0:5795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2905ed880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5795:1875552186208256:192.168.201.25@tcp:105: 00010000:00010000:1.0:1788666212.051070:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666212.051116:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a096d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173605248:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 16986us (17276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666212.051130:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:3.0:1788666212.234897:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788666212.234932:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186208384:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788666212.235029:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666212.235305:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186208384 00000100:00100000:1.0:1788666212.235316:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186208384 00000100:00100000:1.0:1788666212.235405:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788666212.235415:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1875552186208384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788666212.235475:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666212.235541:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3276:x1875552186208384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666212.235570:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788666212.235757:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1e06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186208384:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788666212.235942:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788666212.326980:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666212.328121:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173605632 00000100:00100000:1.0:1788666212.328142:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173605632 00000100:00100000:0.0:1788666212.328649:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 97 00000100:00100000:0.0:1788666212.328664:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+34:10545:x1875552173605632:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788666212.328712:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666212.328739:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea0cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d429f6 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.328814:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea0d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.328830:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.328848:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666212.328912:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788666212.328916:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788666212.328933:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea0d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.328956:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea0cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429f6 expref: 36 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.328989:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea0d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429f6 expref: 35 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.328998:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:0.0:1788666212.329001:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788666212.329007:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144a800, rc 0) 00000100:00100000:0.0:1788666212.329095:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+35:10545:x1875552173605632:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 433us (2136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666212.329103:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 97 00000100:00100000:0.0:1788666212.336849:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666212.337367:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173605888 00000100:00100000:2.0:1788666212.337381:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173605888 00000100:00100000:2.0:1788666212.337462:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 98 00000100:00100000:2.0:1788666212.337473:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+35:10545:x1875552173605888:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666212.337527:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666212.337568:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3c00/0x96bbe788361ea0d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d429fd expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666212.337745:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea0e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666212.337762:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666212.337777:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea0e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666212.337790:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788666212.337956:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3c00/0x96bbe788361ea0d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429fd expref: 38 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666212.337981:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea0e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429fd expref: 37 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666212.337991:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab2b9e72300) 00010000:00010000:2.0:1788666212.337995:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666212.338000:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2400, rc 0) 00000100:00100000:2.0:1788666212.338090:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+37:10545:x1875552173605888:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 619us (1255us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788666212.338099:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 98 00000100:00100000:2.0:1788666212.343958:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666212.344068:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173606144 00000100:00100000:0.0:1788666212.344092:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173606144 00000100:00100000:0.0:1788666212.344183:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 99 00000100:00100000:0.0:1788666212.344196:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+37:10545:x1875552173606144:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788666212.344241:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666212.344278:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea0ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a04 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.344439:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea0f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.344473:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea0f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.344490:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea0f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666212.344509:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788666212.344802:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea0ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a04 expref: 40 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.344822:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea0f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a04 expref: 39 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.344832:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab2b9e72300) 00010000:00010000:0.0:1788666212.344835:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788666212.344839:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144b400, rc 0) 00000100:00100000:0.0:1788666212.344913:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+39:10545:x1875552173606144:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 719us (967us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1788666212.344922:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 99 00000100:00100000:0.0:1788666212.350287:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666212.350649:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173606272 00000100:00100000:2.0:1788666212.350663:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173606272 00000100:00100000:2.0:1788666212.350767:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:2.0:1788666212.350779:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+39:2363:x1875552173606272:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788666212.350818:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666212.350855:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea0e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429fd expref: 39 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666212.350883:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab2b9e72300) 00010000:00010000:2.0:1788666212.350891:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666212.350979:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+38:2363:x1875552173606272:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 202us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666212.350987:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00010000:00010000:1.0:1788666212.362837:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666212.367411:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666212.367732:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173606400 00000100:00100000:1.0:1788666212.367746:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173606400 00000100:00100000:1.0:1788666212.367822:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00100000:1.0:1788666212.367835:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173606400:12345-192.168.201.25@tcp:1:lfs.0 00010000:00010000:1.0:1788666212.367915:0:6651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea103 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.367941:0:6651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea0c4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429ef expref: 6 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.367950:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788666212.367955:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788666212.367961:0:6651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea103 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.368004:0:6651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea0c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429ef expref: 6 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.368019:0:6651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429ef expref: 6 pid: 6649 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666212.368037:0:6651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2905ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6651:1875552186208512:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788666212.368200:0:6651:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab181165a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788666212.373190:0:6651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2905ee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6651:1875552186208512:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788666212.373254:0:6651:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea103 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666212.376057:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666212.377025:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173606528 00000100:00100000:0.0:1788666212.377042:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173606528 00002000:00100000:0.0:1788666212.377139:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8ab2c1e06300 x1875552173606528/t0(0) o4->0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp:253/0 lens 504/0 e 0 to 0 dl 1788666223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788666212.377153:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab2c1e06300 with x1875552173606528 ext(0->8) 00010000:00010000:0.0:1788666212.377169:0:6655:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429ef expref: 7 pid: 6649 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.377220:0:6655:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429ef expref: 7 pid: 6649 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788666212.377244:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ab2c1e06300 00000100:00100000:0.0:1788666212.377298:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:0.0:1788666212.377312:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173606528:12345-192.168.201.25@tcp:4:lfs.0 00000100:00100000:0.0:1788666212.379054:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0911d461-5865-4ef7-8c3e-012fc04add58+9:2363:x1875552173606528:12345-192.168.201.25@tcp:4:lfs.0 Request processed in 1731us (3001us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788666212.379069:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 1 00002000:00100000:0.0:1788666212.379091:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8ab2c1e06300 x1875552173606528/t4294967302(0) o4->0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp:253/0 lens 504/448 e 0 to 0 dl 1788666223 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788666212.379102:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab2c1e06300 with x1875552173606528 ext(0->8) 00010000:00010000:0.0:1788666212.379112:0:6655:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429ef expref: 9 pid: 6649 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.379136:0:6655:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429ef expref: 9 pid: 6649 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788666212.379145:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ab2c1e06300 00000100:00100000:0.0:1788666212.384862:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666212.385515:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173606656 00000100:00100000:1.0:1788666212.385536:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173606656 00010000:00010000:1.0:1788666212.385762:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429ef expref: 9 pid: 6649 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666212.385883:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:1.0:1788666212.385897:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+9:2362:x1875552173606656:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666212.385922:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788666212.385953:0:5795:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788666212.385956:0:5795:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788666212 00002000:00010000:1.0:1788666212.385959:0:5795:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788666212 00002000:00010000:1.0:1788666212.385961:0:5795:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788666212 00010000:00010000:1.0:1788666212.385982:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea0c4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429ef expref: 9 pid: 6649 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.385998:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea0c4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429ef expref: 9 pid: 6649 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.386027:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea0c4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429ef expref: 9 pid: 6649 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.386091:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788666212.386097:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788666212.386108:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea103 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.386123:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea103 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.386169:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666212.386284:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+8:2362:x1875552173606656:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 389us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666212.386295:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 50 00010000:00010000:0.0:1788666212.386374:0:6651:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea103 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.386396:0:6651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea103 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.386447:0:6651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea103 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.386458:0:6651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea103 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.386468:0:6651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea103 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.386477:0:6651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855200 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:0.0:1788666212.386482:0:6651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea103 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.386493:0:6651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea103 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.386507:0:6651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea103 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.386515:0:6651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea103 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666212.386571:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173606400:12345-192.168.201.25@tcp:1:lfs.0 Request processed in 18738us (19177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666212.386613:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00100000:0.0:1788666212.391775:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666212.392204:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173606912 00000100:00100000:3.0:1788666212.392219:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173606912 00000100:00100000:3.0:1788666212.392297:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00100000:3.0:1788666212.392311:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28f365450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+38:10545:x1875552173606912:12345-192.168.201.25@tcp:35:lfs.0 00000004:00010000:3.0:1788666212.392568:0:5811:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea0f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a04 expref: 38 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788666212.393296:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1788666212.393368:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1788666212.394924:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1788666212.397799:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea10a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.397837:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea0af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429e1 expref: 42 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.397848:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea10a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.397903:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea0af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429e1 expref: 42 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.397918:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea0af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429e1 expref: 42 pid: 12001 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666212.397935:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9daa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5811:1875552186208640:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788666212.402318:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab283891300 going to sleep for 11 seconds 00000100:00100000:2.0:1788666212.402913:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666212.402995:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173607040 00000100:00100000:1.0:1788666212.403006:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173607040 00010000:00010000:1.0:1788666212.403058:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea0af lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429e1 expref: 43 pid: 12001 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666212.403119:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:1.0:1788666212.403133:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+43:2363:x1875552173607040:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666212.403156:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666212.403163:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea0af lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429e1 expref: 43 pid: 12001 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.403179:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea0af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429e1 expref: 43 pid: 12001 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.403246:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab2b9e72300) 00010000:00010000:1.0:1788666212.403252:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea10a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.403265:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea10a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.403273:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea10a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.403299:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666212.403370:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+43:2363:x1875552173607040:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 239us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666212.403392:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 51 00010000:00010000:3.0:1788666212.404902:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea0af lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429e1 expref: 42 pid: 12001 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666212.404928:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9daa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5811:1875552186208640:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788666212.404955:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea10a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.404992:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea10a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.404999:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea10a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788666212.405158:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788666212.405839:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1788666212.406214:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9daa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5811:1875552186208768:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788666212.406816:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666212.406910:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab283891600 going to sleep for 11 seconds 00000100:00100000:1.0:1788666212.409003:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186208768 00000100:00100000:1.0:1788666212.409024:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186208768 00000100:00100000:1.0:1788666212.409152:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788666212.409165:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5811:x1875552186208768:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788666212.409403:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5811:x1875552186208768:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 241us (2590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666212.409413:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788666212.409976:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788666212.410057:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9daa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5811:1875552186208768:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788666212.410934:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:3.0:1788666212.411063:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9daa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5811:1875552186208896:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788666212.411143:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666212.411173:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab284e7d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788666212.411780:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186208896 00000100:00100000:0.0:1788666212.411793:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186208896 00000100:00100000:0.0:1788666212.411842:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788666212.411851:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5811:x1875552186208896:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788666212.412162:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5811:x1875552186208896:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 310us (1017us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788666212.412170:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788666212.412562:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9daa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5811:1875552186208896:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788666212.412695:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:3.0:1788666212.412762:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea10a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.412776:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea10a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.412785:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea10a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.412810:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff000 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666212.412816:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea10a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.412825:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea10a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.412849:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab2b9e72300) 00010000:00010000:3.0:1788666212.412852:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788666212.412859:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea10a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.412866:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea10a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788666212.413134:0:5811:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788666212.413299:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:3.0:1788666212.413314:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 319121733429ns, next at 320121729949ns, rc = 0 00000001:00080000:3.0:1788666212.413321:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:3.0:1788666212.413372:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab2b9e72300) 00010000:00010000:3.0:1788666212.413375:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788666212.413384:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea0f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a04 expref: 46 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666212.414131:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28f365450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+45:10545:x1875552173606912:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 21820us (22366us total) trans 4294967388 rc 0/0 00000100:00100000:3.0:1788666212.414144:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 26 00000020:00080000:3.0:1788666212.414150:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788666212.418838:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666212.418951:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173607168 00000100:00100000:0.0:1788666212.419033:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173607168 00000100:00100000:0.0:1788666212.419176:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 100 00000100:00100000:0.0:1788666212.419202:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+45:10545:x1875552173607168:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788666212.419247:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666212.419280:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea111 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a0b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.419799:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea111 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a0b expref: 46 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.419819:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea111 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a0b expref: 46 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.419841:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:0.0:1788666212.419845:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788666212.419849:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144a600, rc 0) 00000100:00100000:0.0:1788666212.419936:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+46:10545:x1875552173607168:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 748us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666212.420481:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 100 00000100:00100000:2.0:1788666212.425340:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666212.425440:0:11980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173607424 00000100:00100000:3.0:1788666212.425454:0:11980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173607424 00000100:00100000:3.0:1788666212.425530:0:11980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:3.0:1788666212.425542:0:11980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+46:10545:x1875552173607424:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1788666212.425859:0:11980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+47:10545:x1875552173607424:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 319us (539us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1788666212.425867:0:11980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:1.0:1788666212.566226:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666212.566450:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173607552 00000100:00100000:3.0:1788666212.566467:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173607552 00000100:00100000:3.0:1788666212.566551:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 101 00000100:00100000:3.0:1788666212.566562:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+47:10555:x1875552173607552:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:3.0:1788666212.566688:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea118 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.566709:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea118 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.566723:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea118 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.566741:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea11f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.566748:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea11f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.566754:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea11f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.566891:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea126 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.566919:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea126 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.566927:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea126 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788666212.566981:0:12001:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea126 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.566994:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea118 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.567001:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea118 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.567009:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea118 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.567016:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff000 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666212.567020:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea118 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.567028:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea118 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.567042:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:3.0:1788666212.567046:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666212.567052:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea118 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.567059:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea118 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.567094:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea11f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.567101:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea11f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.567108:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea11f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.567115:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814fe400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666212.567118:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea11f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.567125:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea11f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.567133:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab2b9e72300) 00010000:00010000:3.0:1788666212.567135:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666212.567139:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea11f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.567146:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea11f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.567163:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea126 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.567169:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea126 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.567175:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea126 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.567185:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814fe600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666212.567188:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea126 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.567193:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea126 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.567201:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:3.0:1788666212.567203:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666212.567206:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea126 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.567210:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea126 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666212.567323:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+47:10555:x1875552173607552:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 761us (1110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666212.567332:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 101 00000100:00100000:2.0:1788666212.651441:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666212.651635:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173607808 00000100:00100000:1.0:1788666212.651652:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173607808 00000100:00100000:1.0:1788666212.651761:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 102 00000100:00100000:1.0:1788666212.651774:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+47:10558:x1875552173607808:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788666212.651800:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666212.651849:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea12d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a12 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.651972:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea134 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.651991:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea134 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652008:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea134 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652028:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea13b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652038:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea13b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652044:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea13b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652257:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea142 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652266:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652274:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666212.652288:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788666212.652472:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea134 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652496:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea134 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652504:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea134 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652512:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298854400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666212.652519:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea134 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652528:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea134 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652547:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:1.0:1788666212.652552:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666212.652558:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea134 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652569:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea134 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652637:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea13b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652644:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea13b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652650:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea13b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652655:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298854600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666212.652665:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea13b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652672:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea13b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652680:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab2908f2300) 00010000:00010000:1.0:1788666212.652683:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666212.652685:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea13b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652690:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea13b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652756:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea12d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a12 expref: 50 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652772:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea142 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a12 expref: 49 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666212.652780:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:1.0:1788666212.652783:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788666212.652785:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855e00, rc 0) 00000100:00100000:1.0:1788666212.652888:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290579180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+49:10558:x1875552173607808:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1116us (1479us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788666212.652897:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 102 00000100:00100000:2.0:1788666212.663776:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666212.664966:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173607936 00000100:00100000:0.0:1788666212.664984:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173607936 00000100:00100000:0.0:1788666212.665187:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 103 00000100:00100000:0.0:1788666212.665203:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29057b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+49:10558:x1875552173607936:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:0.0:1788666212.665626:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea150 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.665651:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.665671:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.665718:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea150 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.665726:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea150 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.665734:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea150 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.665744:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144ae00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666212.665751:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea150 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.665762:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea150 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.665779:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:0.0:1788666212.665813:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788666212.665821:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea150 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.665942:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea150 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666212.666561:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29057b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+49:10558:x1875552173607936:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 1354us (2794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666212.666575:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 103 00000100:00100000:0.0:1788666212.683891:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666212.684040:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173608192 00000100:00100000:3.0:1788666212.684054:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173608192 00000100:00100000:3.0:1788666212.684204:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:3.0:1788666212.684221:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+49:10558:x1875552173608192:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1788666212.684647:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+50:10558:x1875552173608192:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 431us (771us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788666212.684656:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:2.0:1788666212.857557:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666212.858055:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173608448 00000100:00100000:0.0:1788666212.858115:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173608448 00000100:00100000:0.0:1788666212.858279:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 104 00000100:00100000:0.0:1788666212.858294:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29057aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+50:10568:x1875552173608448:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:0.0:1788666212.858342:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666212.858359:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788666212.858399:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea0d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429f6 expref: 50 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.858425:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:0.0:1788666212.858431:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788666212.858449:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea157 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a19 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.858645:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea15e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.858661:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea15e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.858694:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea15e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666212.858707:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788666212.858898:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea157 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a19 expref: 52 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.858915:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea15e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a19 expref: 51 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.858923:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:0.0:1788666212.858926:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788666212.858928:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144b400, rc 0) 00000100:00100000:0.0:1788666212.859024:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29057aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+51:10568:x1875552173608448:12345-192.168.201.25@tcp:101:bash.0 Request processed in 734us (1483us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788666212.859033:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 104 00000100:00100000:2.0:1788666212.866821:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666212.868429:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173608576 00000100:00100000:3.0:1788666212.868449:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173608576 00000100:00100000:3.0:1788666212.868552:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:3.0:1788666212.868607:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290579c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+51:2364:x1875552173608576:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666212.868634:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666212.868667:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea15e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a19 expref: 51 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.868693:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:3.0:1788666212.868699:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666212.868774:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290579c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+50:2364:x1875552173608576:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 171us (1966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666212.868782:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:2.0:1788666212.881758:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666212.881961:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173608832 00000100:00100000:0.0:1788666212.881975:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173608832 00000100:00100000:0.0:1788666212.882058:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 105 00000100:00100000:0.0:1788666212.882077:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+50:10568:x1875552173608832:12345-192.168.201.25@tcp:36:bash.0 00010000:00010000:0.0:1788666212.882165:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666212.882199:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea142 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a12 expref: 50 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.882222:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:0.0:1788666212.882227:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788666212.882745:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea16c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.882762:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea16c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.882773:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea16c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788666212.883114:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1788666212.883215:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000065c74b65 reply state 000000000c5f8faa transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea16c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666212.883227:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788666212.883334:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290578e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+52:10568:x1875552173608832:12345-192.168.201.25@tcp:36:bash.0 Request processed in 1257us (1587us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1788666212.883539:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 105 00000020:00080000:0.0:1788666212.883547:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788666212.885845:0:3261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea16c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.885880:0:3261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea16c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.885891:0:3261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea16c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.885898:0:3261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144ae00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666212.885911:0:3261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea16c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.885923:0:3261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea16c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.885951:0:3261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:3.0:1788666212.885955:0:3261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666212.885961:0:3261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea16c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666212.886007:0:3261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea16c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666212.888901:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666212.889137:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173608960 00000100:00100000:0.0:1788666212.889150:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173608960 00000100:00100000:0.0:1788666212.889230:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 106 00000100:00100000:0.0:1788666212.889242:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae27a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+51:10568:x1875552173608960:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:0.0:1788666212.889268:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666212.889294:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea173 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a20 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.889411:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea17a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.889440:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea17a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.889483:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea17a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666212.889520:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788666212.889529:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788666212.889550:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea17a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.889637:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea173 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a20 expref: 53 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.889666:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea17a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a20 expref: 52 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666212.889677:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:0.0:1788666212.889680:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788666212.889685:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144b800, rc 0) 00000100:00100000:0.0:1788666212.889764:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae27a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+52:10568:x1875552173608960:12345-192.168.201.25@tcp:101:bash.0 Request processed in 524us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666212.889772:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 106 00000100:00100000:2.0:1788666212.896635:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666212.896943:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173609216 00000100:00100000:1.0:1788666212.896955:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173609216 00000100:00100000:1.0:1788666212.897032:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 29 00000100:00100000:1.0:1788666212.897043:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+52:10568:x1875552173609216:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:1.0:1788666212.898216:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+53:10568:x1875552173609216:12345-192.168.201.25@tcp:35:bash.0 Request processed in 1161us (1577us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788666212.898564:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 29 00000100:00100000:2.0:1788666213.003242:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666213.003394:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173609344 00000100:00100000:0.0:1788666213.003420:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173609344 00000100:00080000:3.0:1788666213.003621:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666213.004459:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 107 00000100:00100000:0.0:1788666213.004482:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae27b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+53:10574:x1875552173609344:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788666213.004516:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666213.004543:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea181 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a27 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.004721:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea188 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.004746:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.004763:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666213.004823:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788666213.004829:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788666213.004856:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea188 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.004889:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea181 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a27 expref: 55 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.004915:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea188 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a27 expref: 54 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.004926:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:0.0:1788666213.004929:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788666213.004934:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144aa00, rc 0) 00000100:00100000:0.0:1788666213.005050:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae27b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+54:10574:x1875552173609344:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 576us (1841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666213.005060:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 107 00000100:00100000:2.0:1788666213.011016:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666213.011121:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173609472 00000100:00100000:1.0:1788666213.011133:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173609472 00000100:00100000:1.0:1788666213.011214:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 108 00000100:00100000:1.0:1788666213.011339:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+54:10574:x1875552173609472:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788666213.011367:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666213.011422:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea18f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a2e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011504:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea196 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011522:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea196 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011537:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea196 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011556:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea19d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011564:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea19d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011571:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea19d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011705:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea1a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011737:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011745:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666213.011802:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788666213.011810:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788666213.011840:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011857:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea1a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011868:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea196 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011876:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea196 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011884:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea196 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011891:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298854600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666213.011896:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea196 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011904:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea196 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011917:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:1.0:1788666213.011921:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666213.011936:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea196 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011943:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea196 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011960:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea19d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011967:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea19d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011973:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea19d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011978:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298854400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666213.011981:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea19d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011987:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea19d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.011995:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab2908f2300) 00010000:00010000:1.0:1788666213.011998:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666213.012000:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea19d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.012006:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea19d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.012043:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea18f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a2e expref: 56 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.012085:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a2e expref: 55 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.012094:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:1.0:1788666213.012097:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788666213.012099:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298854200, rc 0) 00000100:00100000:1.0:1788666213.012207:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+55:10574:x1875552173609472:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 871us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666213.022358:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 108 00000100:00100000:2.0:1788666213.022977:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666213.023012:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173609728 00000100:00100000:2.0:1788666213.023024:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173609728 00000100:00100000:2.0:1788666213.023092:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 109 00000100:00100000:2.0:1788666213.023120:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+55:10574:x1875552173609728:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666213.023156:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666213.023197:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea1ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a35 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.023326:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea1b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.023343:0:7132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea17a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a20 expref: 56 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.023352:0:7132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea1a4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a2e expref: 56 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.023361:0:7132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea1b2 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.023423:0:7132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea1a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a2e expref: 56 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.023439:0:7132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea1a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a2e expref: 56 pid: 5810 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666213.023458:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988ff480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186209024:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666213.023618:0:7132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea17a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a20 expref: 56 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.023627:0:7132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea17a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a20 expref: 56 pid: 5808 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666213.023644:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186209152:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788666213.023689:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2c1b6b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666213.023760:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666213.023789:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173609856 00000100:00100000:2.0:1788666213.023794:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173609856 00010000:00010000:2.0:1788666213.023817:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea1a4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a2e expref: 57 pid: 5810 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666213.023847:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:2.0:1788666213.023855:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+57:2364:x1875552173609856:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788666213.023867:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666213.023875:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea1a4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a2e expref: 57 pid: 5810 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.023887:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea1a4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a2e expref: 57 pid: 5810 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.023910:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:2.0:1788666213.023915:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea1b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.023922:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea1b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.023930:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666213.023954:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa76300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+57:2364:x1875552173609856:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 100us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666213.023967:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:2.0:1788666213.031926:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666213.032106:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173609984 00000100:00100000:3.0:1788666213.032122:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173609984 00010000:00010000:3.0:1788666213.032243:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea17a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a20 expref: 57 pid: 5808 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666213.032294:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 53 00000100:00100000:3.0:1788666213.032306:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+57:2363:x1875552173609984:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666213.032327:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666213.032336:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea17a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a20 expref: 57 pid: 5808 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.032351:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea17a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a20 expref: 57 pid: 5808 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.032389:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:3.0:1788666213.032395:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea1b2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.032416:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea1b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.032426:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea1b2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.032453:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666213.032550:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+57:2363:x1875552173609984:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 245us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666213.032559:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 53 00010000:00010000:1.0:1788666213.034560:0:7132:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.25@tcp) returned -22 from blocking AST (req@000000006f226bcd x1875552186209024) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea1a4 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a2e expref: 56 pid: 5810 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.034613:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea1a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a2e expref: 56 pid: 5810 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666213.034636:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988ff480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186209024:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788666213.034656:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea17a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a20 expref: 55 pid: 5808 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666213.034669:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186209152:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788666213.034707:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:1.0:1788666213.034718:0:7132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea1b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.034730:0:7132:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea1b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.034763:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea1b2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666213.034792:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788666213.035667:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea1ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a35 expref: 56 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.035703:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea1b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a35 expref: 55 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.035714:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:1.0:1788666213.035717:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788666213.035720:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2e00, rc 0) 00000100:00100000:1.0:1788666213.035831:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+55:10574:x1875552173609728:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 12713us (12856us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1788666213.035844:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 109 00000100:00100000:2.0:1788666213.040425:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666213.040610:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173610240 00000100:00100000:3.0:1788666213.040623:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173610240 00000100:00100000:3.0:1788666213.040697:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:3.0:1788666213.040707:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a096fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+55:10574:x1875552173610240:12345-192.168.201.25@tcp:103:lfs.0 00010000:00010000:3.0:1788666213.040725:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666213.040755:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea111 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a0b expref: 55 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.040779:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:3.0:1788666213.040785:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666213.040846:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a096fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+54:10574:x1875552173610240:12345-192.168.201.25@tcp:103:lfs.0 Request processed in 141us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666213.040854:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:2.0:1788666213.045684:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666213.045786:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173610368 00000100:00100000:0.0:1788666213.045800:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173610368 00000100:00100000:0.0:1788666213.045895:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 110 00000100:00100000:0.0:1788666213.045906:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+54:10574:x1875552173610368:12345-192.168.201.25@tcp:58:lfs.0 00010000:00010000:0.0:1788666213.046055:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea1c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.046086:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea1c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.046099:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea1c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788666213.046358:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1788666213.046500:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+54:10574:x1875552173610368:12345-192.168.201.25@tcp:58:lfs.0 Request processed in 595us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666213.046510:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 110 00000100:00100000:0.0:1788666213.053513:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666213.053820:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173610496 00000100:00100000:2.0:1788666213.053836:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173610496 00000100:00100000:2.0:1788666213.053919:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 111 00000100:00100000:2.0:1788666213.053932:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+54:10574:x1875552173610496:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666213.053962:0:12001:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666213.053989:0:12001:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3c00/0x96bbe788361ea1c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a3c expref: -99 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.054078:0:12001:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea1c0 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.054092:0:12001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3c00/0x96bbe788361ea1c7 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a3c expref: 55 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.054117:0:12001:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea1c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.054134:0:12001:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3c00/0x96bbe788361ea1c7 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a3c expref: 55 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.054154:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:2.0:1788666213.054158:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788666213.054162:0:12001:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3c00/0x96bbe788361ea1c7 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a3c expref: 55 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.054193:0:12001:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f3c00, rc 0) 00000100:00100000:2.0:1788666213.054291:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+55:10574:x1875552173610496:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 362us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666213.054300:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 111 00000040:00080000:1.0:1788666213.131351:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788666213.131371:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788666213.132648:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788666213.132675:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788666213.132941:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2905ed880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875552186209280:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788666213.133709:0:11650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab181165d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788666213.155725:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2905ed880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875552186209280:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788666213.157638:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666213.157801:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173610624 00000100:00100000:1.0:1788666213.157817:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173610624 00000100:00100000:1.0:1788666213.157927:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 112 00000100:00100000:1.0:1788666213.157967:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+55:10575:x1875552173610624:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788666213.158019:0:7132:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788666213.158792:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+55:10575:x1875552173610624:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 252us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666213.158805:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 112 00000100:00100000:0.0:1788666213.175298:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666213.175754:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173610752 00000100:00100000:3.0:1788666213.175769:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173610752 00000100:00100000:3.0:1788666213.176387:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 113 00000100:00100000:3.0:1788666213.176402:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+55:10575:x1875552173610752:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788666213.176537:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea1ce lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.176563:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea1ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.176639:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea1ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.176710:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea1d5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.176718:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.176726:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.176760:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea1dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.176770:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea1dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.176787:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea1dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666213.176845:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788666213.176852:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788666213.176871:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea1dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.176888:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea1ce lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.176895:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea1ce lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.176906:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea1ce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.176923:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814fe600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666213.176929:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea1ce lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.176938:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea1ce lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.176953:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab2908f2b00) 00010000:00010000:3.0:1788666213.176956:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666213.176973:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea1ce lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.176981:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea1ce lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.177000:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea1d5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.177006:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea1d5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.177013:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea1d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.177025:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814fe400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666213.177028:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea1d5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.177035:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea1d5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.177052:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8ab2b9e72300) 00010000:00010000:3.0:1788666213.177055:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666213.177068:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea1d5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.177075:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea1d5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.177090:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea1dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.177095:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea1dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.177102:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea1dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.177107:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff000 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666213.177110:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea1dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.177115:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea1dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.177121:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:3.0:1788666213.177123:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666213.177126:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea1dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.177131:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea1dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666213.177262:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+55:10575:x1875552173610752:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 Request processed in 860us (1983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666213.177271:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 113 00000100:00100000:2.0:1788666213.188708:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666213.188896:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173611008 00000100:00100000:1.0:1788666213.188923:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173611008 00000100:00100000:1.0:1788666213.189028:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 114 00000100:00100000:1.0:1788666213.189041:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+55:10575:x1875552173611008:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788666213.189081:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666213.189113:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea1e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a43 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.189625:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea1ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.189649:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea1ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.189664:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea1ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666213.189683:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788666213.190519:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea1ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.190534:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea1ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.190542:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea1ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.190601:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855000 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666213.190609:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea1ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.190619:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea1ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.190637:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:1.0:1788666213.190641:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788666213.190647:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea1ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.190653:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea1ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.190727:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea1e3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a43 expref: 57 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.190741:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab2908f2b00) 00010000:00010000:1.0:1788666213.190743:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788666213.190747:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea1e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a43 expref: 57 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.190757:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298854200, rc 0) 00000100:00100000:1.0:1788666213.192543:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+56:10575:x1875552173611008:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 3489us (3839us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1788666213.192558:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 114 00000100:00100000:0.0:1788666213.197362:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666213.197477:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173611136 00000100:00100000:1.0:1788666213.197512:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173611136 00000100:00100000:1.0:1788666213.197623:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 115 00000100:00100000:1.0:1788666213.197634:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+56:10575:x1875552173611136:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788666213.197684:0:7132:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788666213.198343:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+56:10575:x1875552173611136:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 705us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666213.198356:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 115 00000100:00100000:0.0:1788666213.211089:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666213.211253:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173611392 00000100:00100000:1.0:1788666213.211270:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173611392 00000100:00100000:1.0:1788666213.211361:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 116 00000100:00100000:1.0:1788666213.211372:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+56:10575:x1875552173611392:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788666213.211402:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666213.211407:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788666213.211447:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea188 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a27 expref: 56 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.211485:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:1.0:1788666213.211493:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788666213.211512:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea1f8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a4a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788666213.212215:0:5808:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1788666213.212463:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea1ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.212480:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea1ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.212502:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea1ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.212564:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea1f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a4a expref: 58 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.212611:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea1ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a4a expref: 57 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.212619:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab2908f2300) 00010000:00010000:1.0:1788666213.212622:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788666213.212625:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855000, rc 0) 00000100:00100000:1.0:1788666213.212711:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+57:10575:x1875552173611392:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 1341us (1637us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788666213.212720:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 116 00000100:00100000:2.0:1788666213.228268:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666213.234224:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173611648 00000100:00100000:1.0:1788666213.234252:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173611648 00000100:00100000:1.0:1788666213.234438:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 117 00000100:00100000:1.0:1788666213.234453:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+57:10575:x1875552173611648:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788666213.234547:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666213.234606:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea1ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a4a expref: 57 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.234631:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab2908f2300) 00010000:00010000:1.0:1788666213.234644:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788666213.234675:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea20d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.234717:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea20d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.234729:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea20d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.234747:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea214 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x2c8ba71b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.234769:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea214 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c8ba71b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.234778:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea214 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c8ba71b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.234866:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea20d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.234874:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea20d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.234881:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea20d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.234887:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298854200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666213.234893:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea20d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.234901:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea20d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.234910:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:1.0:1788666213.234919:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666213.234925:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea20d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.234931:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea20d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.234940:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea214 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c8ba71b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.234947:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea214 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c8ba71b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.234966:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea214 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c8ba71b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.234971:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298854400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666213.234974:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea214 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c8ba71b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.234980:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea214 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2c8ba71b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.234987:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x2c8ba71b (ffff8ab2908f2700) 00010000:00010000:1.0:1788666213.234990:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666213.234993:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea214 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2c8ba71b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.234999:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea214 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2c8ba71b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666213.235120:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+56:10575:x1875552173611648:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 669us (6867us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788666213.235133:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 117 00000100:00100000:0.0:1788666213.255029:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666213.256780:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173611776 00000100:00100000:1.0:1788666213.256800:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173611776 00000100:00100000:1.0:1788666213.256895:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 118 00000100:00100000:1.0:1788666213.256909:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+56:10575:x1875552173611776:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788666213.256938:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666213.256980:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea21b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a51 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.257026:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea222 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.257044:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.257068:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea222 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.257224:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea21b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a51 expref: 58 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.257254:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea222 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a51 expref: 57 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.257264:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab2908f2400) 00010000:00010000:1.0:1788666213.257268:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788666213.257273:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855c00, rc 0) 00000100:00100000:1.0:1788666213.257378:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+57:10575:x1875552173611776:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 472us (2620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666213.257396:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 118 00000100:00100000:0.0:1788666213.261885:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666213.261998:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173612032 00000100:00100000:2.0:1788666213.262011:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173612032 00000100:00100000:2.0:1788666213.262087:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 119 00000100:00100000:2.0:1788666213.262097:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+57:10575:x1875552173612032:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788666213.262199:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea229 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.262220:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea229 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.262232:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea229 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788666213.262511:0:5809:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1788666213.262522:0:5809:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 319970941303ns, next at 320970938825ns, rc = 0 00000004:00010000:2.0:1788666213.262641:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000035462757 reply state 00000000a6037e26 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea229 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666213.262650:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788666213.262755:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+59:10575:x1875552173612032:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 658us (883us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788666213.262779:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 119 00010000:00010000:3.0:1788666213.266745:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea229 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.266774:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea229 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.266783:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea229 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.266790:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666213.266795:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea229 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.266804:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea229 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.266825:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab2908f2400) 00010000:00010000:3.0:1788666213.266828:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788666213.266833:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea229 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.266841:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea229 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666213.276710:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666213.276960:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173612160 00000100:00100000:1.0:1788666213.276974:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173612160 00000100:00100000:1.0:1788666213.277053:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 120 00000100:00100000:1.0:1788666213.277072:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+58:10575:x1875552173612160:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788666213.277108:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666213.277146:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea230 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a58 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.277239:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea230 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a58 expref: 59 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.277258:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea230 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a58 expref: 59 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.277282:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab2908f2400) 00010000:00010000:1.0:1788666213.277286:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788666213.277290:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298854600, rc 0) 00000100:00100000:1.0:1788666213.277377:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+59:10575:x1875552173612160:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 306us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666213.277384:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 120 00000100:00100000:2.0:1788666213.295530:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666213.297792:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173612288 00000100:00100000:0.0:1788666213.297817:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173612288 00000100:00100000:0.0:1788666213.297937:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:0.0:1788666213.297959:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+8:2364:x1875552173612288:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788666213.298633:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa75880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+9:2364:x1875552173612288:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 684us (3113us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788666213.298668:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00080000:3.0:1788666213.299001:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788666213.312052:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666213.313544:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173612544 00000100:00100000:3.0:1788666213.313571:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173612544 00000100:00100000:3.0:1788666213.313791:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 30 00000100:00100000:3.0:1788666213.313807:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+59:10575:x1875552173612544:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788666213.315356:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+60:10575:x1875552173612544:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 411us (2179us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1788666213.315374:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 30 00000100:00100000:1.0:1788666213.320663:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666213.321269:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173612800 00000100:00100000:3.0:1788666213.321284:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173612800 00000100:00100000:3.0:1788666213.321363:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 121 00000100:00100000:3.0:1788666213.321374:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+60:10575:x1875552173612800:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788666213.321551:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+60:10575:x1875552173612800:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 178us (902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666213.321560:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 121 00000100:00100000:2.0:1788666213.331254:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666213.331533:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173612928 00000100:00100000:1.0:1788666213.331548:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173612928 00000100:00100000:1.0:1788666213.331668:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 122 00000100:00100000:1.0:1788666213.331679:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+60:10575:x1875552173612928:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788666213.331731:0:12001:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666213.331785:0:12001:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea237 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a5f expref: -99 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.332042:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea23e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.332068:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea23e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.332085:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea23e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666213.332212:0:12001:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788666213.332235:0:12001:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea23e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.332266:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea237 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a5f expref: 62 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.332285:0:12001:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea23e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a5f expref: 61 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.332294:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab2908f2400) 00010000:00010000:1.0:1788666213.332297:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788666213.332300:0:12001:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855000, rc 0) 00000100:00100000:1.0:1788666213.332372:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+61:10575:x1875552173612928:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 695us (1132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666213.332381:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 122 00000100:00100000:0.0:1788666213.345350:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666213.345466:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173613056 00000100:00100000:3.0:1788666213.345479:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173613056 00000100:00100000:3.0:1788666213.345564:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:3.0:1788666213.345575:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+9:2364:x1875552173613056:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788666213.345634:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666213.345658:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068393ce0/0x96bbe788361ea245 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a66 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788666213.345693:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ce165, blocks: 0x1 00010000:00010000:3.0:1788666213.345719:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=320s v=(0 0) 00010000:00010000:3.0:1788666213.345724:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666213.345735:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068393ce0/0x96bbe788361ea245 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a66 expref: 10 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.345785:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000068393ce0/0x96bbe788361ea245 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a66 expref: 10 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.345800:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814ff000, rc 0) 00000100:00100000:2.0:1788666213.346276:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+10:2364:x1875552173613056:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 699us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666213.346286:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:2.0:1788666213.361456:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666213.361650:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173613312 00000100:00100000:1.0:1788666213.361666:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173613312 00000100:00100000:1.0:1788666213.362030:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 123 00000100:00100000:1.0:1788666213.362047:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+61:10575:x1875552173613312:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788666213.362374:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+61:10575:x1875552173613312:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 263us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666213.362385:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 123 00000100:00100000:0.0:1788666213.378702:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666213.378878:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173613440 00000100:00100000:3.0:1788666213.378897:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173613440 00000100:00100000:3.0:1788666213.379047:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:3.0:1788666213.379069:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+10:10575:x1875552173613440:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788666213.379090:0:6650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666213.379111:0:6650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddc33ef1/0x96bbe788361ea24c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a6d expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.379283:0:6650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000068393ce0/0x96bbe788361ea245 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a66 expref: 11 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.379294:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666213.379300:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666213.379306:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddc33ef1/0x96bbe788361ea24c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a6d expref: 11 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.379351:0:6650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000068393ce0/0x96bbe788361ea245 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a66 expref: 11 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.379367:0:6650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000068393ce0/0x96bbe788361ea245 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a66 expref: 11 pid: 8429 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666213.379403:0:6650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1e05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6650:1875552186209408:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788666213.379552:0:6650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab290495d80 going to sleep for 11 seconds 00010000:00010000:0.0:1788666213.386969:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666213.399200:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666213.399365:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173613568 00000100:00100000:1.0:1788666213.399376:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173613568 00000100:00100000:3.0:1788666213.399388:0:6650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1e05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6650:1875552186209408:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788666213.399430:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000068393ce0/0x96bbe788361ea245 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a66 expref: 12 pid: 8429 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.399439:0:6650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ddc33ef1/0x96bbe788361ea24c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a6d expref: 12 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.399456:0:6650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814fe400, rc 0) 00000100:00100000:1.0:1788666213.399478:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 54 00000100:00100000:1.0:1788666213.399487:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+12:2363:x1875552173613568:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666213.399503:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788666213.399514:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+12:10575:x1875552173613440:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 20458us (20828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666213.399522:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 40 00010000:00010000:1.0:1788666213.399531:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000068393ce0/0x96bbe788361ea245 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a66 expref: 12 pid: 8429 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.399544:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000068393ce0/0x96bbe788361ea245 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a66 expref: 11 pid: 8429 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.399570:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068393ce0/0x96bbe788361ea245 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a66 expref: 11 pid: 8429 timeout: 420 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.399625:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666213.399630:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666213.399654:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ddc33ef1/0x96bbe788361ea24c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a6d expref: 10 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.399665:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddc33ef1/0x96bbe788361ea24c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a6d expref: 10 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.399702:0:5793:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ddc33ef1/0x96bbe788361ea24c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a6d expref: 10 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666213.399717:0:5793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2905ec700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5793:1875552186209536:192.168.201.25@tcp:105: 00000100:00100000:1.0:1788666213.399782:0:5793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab181165000 going to sleep for 11 seconds 00000100:00100000:3.0:1788666213.409700:0:5793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2905ec700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5793:1875552186209536:192.168.201.25@tcp:105: 00010000:00010000:3.0:1788666213.409733:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666213.409822:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+10:2363:x1875552173613568:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 10336us (10635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666213.409834:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 54 00000100:00100000:0.0:1788666213.414547:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666213.414723:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173613696 00000100:00100000:2.0:1788666213.414734:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173613696 00002000:00100000:2.0:1788666213.414810:0:6654:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8ab2bfaac380 x1875552173613696/t0(0) o4->0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp:254/0 lens 504/0 e 0 to 0 dl 1788666224 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788666213.414824:0:6654:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab2bfaac380 with x1875552173613696 ext(0->12) 00002000:00010000:2.0:1788666213.414830:0:6654:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab2bfaac380 00000100:00100000:2.0:1788666213.414866:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:2.0:1788666213.414876:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0911d461-5865-4ef7-8c3e-012fc04add58+10:2364:x1875552173613696:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788666213.416119:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0911d461-5865-4ef7-8c3e-012fc04add58+12:2364:x1875552173613696:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 Request processed in 1231us (1575us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788666213.416134:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 2 00002000:00100000:2.0:1788666213.416146:0:6654:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8ab2bfaac380 x1875552173613696/t4294967308(0) o4->0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp:254/0 lens 504/448 e 0 to 0 dl 1788666224 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788666213.416157:0:6654:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab2bfaac380 with x1875552173613696 ext(0->12) 00002000:00010000:2.0:1788666213.416163:0:6654:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab2bfaac380 00000100:00100000:0.0:1788666213.423391:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666213.423689:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173613824 00000100:00100000:2.0:1788666213.423704:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173613824 00000100:00100000:2.0:1788666213.423820:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 124 00000100:00100000:2.0:1788666213.423833:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+61:10575:x1875552173613824:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788666213.572820:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967394 is committed 00000001:00080000:3.0:1788666213.572858:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000004:00080000:3.0:1788666213.572875:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788666213.572896:0:5830:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:3.0:1788666213.572907:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:3.0:1788666213.572911:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000001:00080000:3.0:1788666213.572924:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1788666213.572934:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788666213.572950:0:5830:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab2bcd906c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788666213.572976:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab2bfa27900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab2bcd90f00 00000020:00080000:3.0:1788666213.572980:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab2bfa27800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab2b4578800 00000020:00080000:3.0:1788666213.573009:0:5830:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab2c1b6b300 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788666213.573012:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab2c1e0b100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab2c1b6bb40 00000020:00080000:3.0:1788666213.573015:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab2c1e0bf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab2bc2db000 00000100:00100000:1.0:1788666213.573693:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+15:10575:x1875552173613824:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 Request processed in 149855us (150315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666213.573705:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 124 00000020:00080000:0.0:1788666213.577632:0:5841:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1788666213.577870:0:5841:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788666213.577899:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2905eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186209792:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788666213.577994:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666213.578150:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186209664:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788666213.578196:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666213.581956:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab290579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186209920:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788666213.582045:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666213.587948:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666213.591508:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186209792 00000100:00100000:0.0:1788666213.591533:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186209792 00000100:00100000:0.0:1788666213.591634:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186209664 00000100:00100000:0.0:1788666213.591637:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186209664 00000100:00100000:0.0:1788666213.591655:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186209920 00000100:00100000:0.0:1788666213.591658:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186209920 00000100:00100000:0.0:1788666213.591679:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788666213.591693:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3277:x1875552186209792:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788666213.591735:0:8429:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1788666213.591784:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9ce164, atime: 0x6a9ce164, ctime: 0x6a9ce164, blocks: 0x1 00010000:00010000:0.0:1788666213.591795:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d11be39f/0x96bbe788361ea253 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.591817:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=320s v=(0 0) 00010000:00010000:0.0:1788666213.591822:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788666213.591851:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d11be39f/0x96bbe788361ea253 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.591872:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d11be39f/0x96bbe788361ea253 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.591885:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d11be39f/0x96bbe788361ea253 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.591893:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d11be39f/0x96bbe788361ea253 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.591918:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788666213.595369:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3277:x1875552186209792:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3664us (17360us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788666213.595391:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788666213.595522:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788666213.595538:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3276:x1875552186209664:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788666213.595616:0:8429:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:0.0:1788666213.595662:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004422e740/0x96bbe788361ea25a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.595695:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000051a79005/0x96bbe788361ea015 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429cc expref: 11 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.595705:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788666213.595711:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788666213.595732:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004422e740/0x96bbe788361ea25a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.595784:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000051a79005/0x96bbe788361ea015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429cc expref: 11 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.595804:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000051a79005/0x96bbe788361ea015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429cc expref: 11 pid: 6650 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666213.595825:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8429:1875552186210048:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788666213.595932:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab183862e40 going to sleep for 11 seconds 00010000:00010000:0.0:1788666213.595960:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666213.595969:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d11be39f/0x96bbe788361ea253 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.595978:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144b800 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:0.0:1788666213.595984:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d11be39f/0x96bbe788361ea253 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.595997:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d11be39f/0x96bbe788361ea253 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.596020:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d11be39f/0x96bbe788361ea253 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.596029:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d11be39f/0x96bbe788361ea253 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.596071:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666213.596074:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666213.596076:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666213.596349:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788666213.596364:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3278:x1875552186209920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788666213.596596:0:6651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788666213.596600:0:6651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788666213 00002000:00010000:1.0:1788666213.596604:0:6651:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788666213.596606:0:6651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788666213 -> 1788666213 00002000:00010000:1.0:1788666213.596609:0:6651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788666213.596664:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3278:x1875552186209920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 306us (14619us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788666213.596671:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788666213.596916:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173613952 00000100:00100000:3.0:1788666213.596925:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173613952 00000100:00100000:3.0:1788666213.596954:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:3.0:1788666213.596961:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+12:2364:x1875552173613952:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1788666213.597039:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab290579c00/2, rc 0, transno 4294967309 00000100:00100000:3.0:1788666213.597045:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab290579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186209920:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1788666213.597088:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab2905eea00/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788666213.597094:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2905eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186209792:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788666213.601084:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8429:1875552186210048:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788666213.601126:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004422e740/0x96bbe788361ea25a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666213.602065:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666213.605570:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173614080 00000100:00100000:2.0:1788666213.605609:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173614080 00010000:00010000:2.0:1788666213.605672:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000051a79005/0x96bbe788361ea015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429cc expref: 13 pid: 6650 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666213.605732:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 55 00000100:00100000:2.0:1788666213.605745:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+13:2364:x1875552173614080:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788666213.605763:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666213.605769:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000051a79005/0x96bbe788361ea015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429cc expref: 13 pid: 6650 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.605785:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000051a79005/0x96bbe788361ea015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429cc expref: 13 pid: 6650 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.605815:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051a79005/0x96bbe788361ea015 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429cc expref: 13 pid: 6650 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.605841:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788666213.605847:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788666213.605855:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004422e740/0x96bbe788361ea25a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.605885:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004422e740/0x96bbe788361ea25a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.605921:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666213.606004:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+12:2364:x1875552173614080:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 261us (3953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666213.606013:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 55 00010000:00010000:2.0:1788666213.606044:0:8429:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004422e740/0x96bbe788361ea25a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.606066:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004422e740/0x96bbe788361ea25a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.606082:0:8429:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004422e740/0x96bbe788361ea25a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.606091:0:8429:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004422e740/0x96bbe788361ea25a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.606115:0:8429:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788666213.609818:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3276:x1875552186209664:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14273us (31608us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788666213.609837:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1788666213.609895:0:7593:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666213.609909:0:7593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004422e740/0x96bbe788361ea25a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.609947:0:7593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144a600 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666213.609954:0:7593:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004422e740/0x96bbe788361ea25a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.609967:0:7593:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004422e740/0x96bbe788361ea25a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.609997:0:7593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004422e740/0x96bbe788361ea25a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.610005:0:7593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004422e740/0x96bbe788361ea25a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.610037:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666213.610039:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666213.610041:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788666213.619331:0:3276:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab2c1e05180/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788666213.619353:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186209664:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1788666213.743681:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:3.0:1788666213.743709:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1788666213.743718:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1788666213.744329:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173613952:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 Request processed in 147357us (156385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666213.744347:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:0.0:1788666213.749733:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666213.749813:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173614336 00000100:00100000:2.0:1788666213.749825:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173614336 00000100:00100000:2.0:1788666213.749888:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 125 00000100:00100000:2.0:1788666213.749897:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+15:10575:x1875552173614336:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788666213.749956:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666213.749988:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea23e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a5f expref: 15 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.750026:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab2908f2400) 00010000:00010000:2.0:1788666213.750033:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788666213.750087:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea261 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.750104:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.750116:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788666213.750474:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013785de3 reply state 0000000035f82bb0 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666213.750486:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788666213.750637:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+16:10575:x1875552173614336:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 739us (910us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788666213.750645:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 125 00010000:00010000:2.0:1788666213.752295:0:3261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea261 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.752313:0:3261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea261 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.752322:0:3261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea261 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.752329:0:3261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666213.752335:0:3261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea261 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.752361:0:3261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea261 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.752378:0:3261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab2908f2400) 00010000:00010000:2.0:1788666213.752381:0:3261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666213.752386:0:3261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea261 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.752393:0:3261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea261 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666213.753846:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666213.754167:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173614464 00000100:00100000:1.0:1788666213.754182:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173614464 00000100:00100000:1.0:1788666213.755072:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:1.0:1788666213.755088:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173614464:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788666213.755478:0:6651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788666213.755484:0:6651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788666213 -> 1788666213 00002000:00010000:1.0:1788666213.755487:0:6651:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788666212 00002000:00010000:1.0:1788666213.755490:0:6651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788666213 -> 1788666213 00002000:00010000:1.0:1788666213.755493:0:6651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788666213.755605:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+7:2364:x1875552173614464:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 491us (1741us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788666213.755614:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:0.0:1788666213.759793:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666213.759894:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173614720 00000100:00100000:2.0:1788666213.759908:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173614720 00000100:00100000:2.0:1788666213.759971:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 126 00000100:00100000:2.0:1788666213.759983:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+15:10575:x1875552173614720:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788666213.760084:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea268 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.760109:0:7132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea222 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a51 expref: 15 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.760121:0:7132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea268 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.760168:0:7132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea222 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a51 expref: 15 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.760183:0:7132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea222 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a51 expref: 15 pid: 7132 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666213.760238:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa74380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186210176:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788666213.760358:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2c1b6bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788666213.773176:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa74380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186210176:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788666213.773302:0:7132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea268 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666213.773683:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666213.773764:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173614848 00000100:00100000:3.0:1788666213.773772:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173614848 00010000:00010000:3.0:1788666213.773821:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea222 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a51 expref: 16 pid: 7132 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666213.773871:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:3.0:1788666213.773883:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+16:2364:x1875552173614848:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666213.773903:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666213.773912:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea222 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a51 expref: 16 pid: 7132 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.773924:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea222 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a51 expref: 16 pid: 7132 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.773948:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea222 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a51 expref: 16 pid: 7132 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.773963:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab2908f2400) 00010000:00010000:3.0:1788666213.773968:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea268 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.773979:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.773989:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea268 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.774032:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666213.774104:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+15:2364:x1875552173614848:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 222us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666213.774115:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 56 00010000:00010000:1.0:1788666213.774402:0:7132:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.774410:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.774460:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea268 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.774468:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea268 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.774478:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea268 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.774497:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666213.774503:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea268 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.774512:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea268 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.774523:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab2908f2400) 00010000:00010000:1.0:1788666213.774526:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788666213.774530:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea268 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.774537:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea268 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666213.774637:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+14:10575:x1875552173614720:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 Request processed in 14656us (14862us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788666213.774646:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 126 00000100:00100000:0.0:1788666213.783521:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666213.791545:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173614976 00000100:00100000:2.0:1788666213.791570:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173614976 00000100:00100000:3.0:1788666213.794518:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:3.0:1788666213.794540:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+7:2364:x1875552173614976:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788666213.794650:0:6649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006bf6329e/0x96bbe788361ea26f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.794674:0:6649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ddc33ef1/0x96bbe788361ea24c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a6d expref: 7 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.794684:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666213.794689:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788666213.794694:0:6649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bf6329e/0x96bbe788361ea26f lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.794744:0:6649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ddc33ef1/0x96bbe788361ea24c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a6d expref: 7 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.794761:0:6649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ddc33ef1/0x96bbe788361ea24c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a6d expref: 7 pid: 6650 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666213.794779:0:6649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab298b90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6649:1875552186210304:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788666213.794883:0:6649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab290495300 going to sleep for 11 seconds 00000100:00100000:0.0:1788666213.799332:0:6649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab298b90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6649:1875552186210304:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788666213.799381:0:6649:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006bf6329e/0x96bbe788361ea26f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666213.800176:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666213.800615:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173615104 00000100:00100000:0.0:1788666213.800625:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173615104 00010000:00010000:0.0:1788666213.800671:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ddc33ef1/0x96bbe788361ea24c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a6d expref: 8 pid: 6650 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666213.800717:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:0.0:1788666213.800728:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+8:2363:x1875552173615104:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788666213.800750:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666213.800789:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ddc33ef1/0x96bbe788361ea24c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a6d expref: 8 pid: 6650 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.800807:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ddc33ef1/0x96bbe788361ea24c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a6d expref: 8 pid: 6650 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.800874:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddc33ef1/0x96bbe788361ea24c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a6d expref: 8 pid: 6650 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.800897:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788666213.800903:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788666213.800912:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006bf6329e/0x96bbe788361ea26f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.800922:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bf6329e/0x96bbe788361ea26f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.801014:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666213.801095:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173615104:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 367us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666213.801103:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 57 00010000:00010000:1.0:1788666213.802057:0:6649:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006bf6329e/0x96bbe788361ea26f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.802075:0:6649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bf6329e/0x96bbe788361ea26f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.802117:0:6649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006bf6329e/0x96bbe788361ea26f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.802126:0:6649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bf6329e/0x96bbe788361ea26f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.802148:0:6649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bf6329e/0x96bbe788361ea26f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.802156:0:6649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814fe600 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:1.0:1788666213.802161:0:6649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bf6329e/0x96bbe788361ea26f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.802171:0:6649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bf6329e/0x96bbe788361ea26f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.802189:0:6649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bf6329e/0x96bbe788361ea26f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.802198:0:6649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bf6329e/0x96bbe788361ea26f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666213.802292:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173614976:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 Request processed in 7757us (18777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666213.802300:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:2.0:1788666213.808777:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666213.808856:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173615360 00000100:00100000:0.0:1788666213.808869:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173615360 00000100:00100000:0.0:1788666213.808950:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 127 00000100:00100000:0.0:1788666213.808962:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+14:10575:x1875552173615360:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788666213.809082:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea276 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.809104:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.809115:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.809521:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea27d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.809534:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea230 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a58 expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.809542:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea27d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.809636:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea230 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a58 expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666213.809653:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea230 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a58 expref: 15 pid: 5810 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666213.809669:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab298b96a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875552186210432:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788666213.809762:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2ae4d1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788666213.813633:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666213.814891:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173615488 00000100:00100000:3.0:1788666213.814912:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173615488 00010000:00010000:3.0:1788666213.814983:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea230 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a58 expref: 16 pid: 5810 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666213.815035:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 58 00000100:00100000:3.0:1788666213.815058:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+16:2363:x1875552173615488:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666213.815082:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666213.815090:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea230 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a58 expref: 16 pid: 5810 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.815107:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea230 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a58 expref: 16 pid: 5810 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.815142:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab2908f2400) 00010000:00010000:3.0:1788666213.815149:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea27d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.815160:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea27d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.815170:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea27d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.815196:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666213.815605:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+16:2363:x1875552173615488:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 558us (1987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666213.815613:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 58 00010000:00010000:2.0:1788666213.819827:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea230 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a58 expref: 15 pid: 5810 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666213.819858:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab298b96a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875552186210432:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666213.819890:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea27d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.824160:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea27d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.824182:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea27d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788666213.824706:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:3.0:1788666213.824898:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:3.0:1788666213.826462:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:3.0:1788666213.827184:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab298b90700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5809:1875552186210560:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788666213.827281:0:5809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666213.827425:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab290495240 going to sleep for 11 seconds 00000100:00100000:0.0:1788666213.834629:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186210560 00000100:00100000:0.0:1788666213.834651:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186210560 00000100:00100000:0.0:1788666213.834810:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788666213.834828:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5809:x1875552186210560:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788666213.835010:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5809:x1875552186210560:12345-0@lo:1000:mdt00_001.0 Request processed in 187us (7729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666213.835018:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788666213.836738:0:5809:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1788666213.836757:0:5809:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1788666213.836787:0:5809:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab290579c00, transno 4294967309 00000100:00100000:3.0:1788666213.836820:0:5809:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8ab2c1e05180 x1875552186209664/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788666229 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666213.836834:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab298b90700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5809:1875552186210560:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788666213.837461:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1788666213.837564:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab298b90700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5809:1875552186210688:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788666213.837722:0:5809:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666213.843186:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab181ab2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788666213.844691:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186210688 00000100:00100000:2.0:1788666213.844709:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186210688 00000100:00100000:2.0:1788666213.844817:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788666213.844831:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5809:x1875552186210688:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788666213.845968:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5809:x1875552186210688:12345-0@lo:1000:mdt00_001.0 Request processed in 1132us (8238us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788666213.845980:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788666213.849551:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab298b90700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5809:1875552186210688:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788666213.850120:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea27d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.850133:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea27d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.850165:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea27d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.850171:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144b400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666213.850176:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea27d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.850184:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea27d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.850200:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab2908f2400) 00010000:00010000:3.0:1788666213.850203:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788666213.850208:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea27d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.850215:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea27d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.850248:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea1c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.850254:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea1c0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.850260:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea1c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.850265:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144a800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666213.850268:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea1c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.850281:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea1c0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.850289:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:3.0:1788666213.850291:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788666213.850298:0:5809:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3c00/0x96bbe788361ea1c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a3c expref: 18 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.850310:0:5809:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3c00/0x96bbe788361ea1c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a3c expref: 18 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.850321:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3c00/0x96bbe788361ea1c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a3c expref: 18 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.850361:0:5809:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3c00/0x96bbe788361ea1c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a3c expref: 18 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666213.850376:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab298b91180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875552186210816:192.168.201.25@tcp:105: 00000100:00100000:3.0:1788666213.851201:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab290495300 going to sleep for 11 seconds 00000100:00100000:1.0:1788666213.864639:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab298b91180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875552186210816:192.168.201.25@tcp:105: 00010000:00010000:1.0:1788666213.864677:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea1c0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.864688:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea1c0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.864749:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea284 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.864764:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea284 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.864777:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea284 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.864788:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea284 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.864794:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea284 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.864802:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea284 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.864808:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855c00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666213.864812:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea284 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.864819:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea284 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.864832:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:1.0:1788666213.864835:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666213.864839:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea284 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.864844:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea284 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.864865:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.864871:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea276 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.864877:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea276 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.864882:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144aa00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666213.864885:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea276 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.864890:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea276 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.864898:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:1.0:1788666213.864900:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788666213.864903:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea276 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.864909:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea276 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666213.865232:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+18:10575:x1875552173615360:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 56270us (56464us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1788666213.865247:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 127 00000020:00080000:1.0:1788666213.865255:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788666213.865777:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788666213.865786:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788666213.866317:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788666213.866328:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788666213.874438:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666213.874492:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666213.874795:0:11980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173615616 00000100:00100000:3.0:1788666213.874809:0:11980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173615616 00000100:00100000:3.0:1788666213.874882:0:11980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173615872 00000100:00100000:3.0:1788666213.874885:0:11980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173615872 00000100:00100000:3.0:1788666213.874903:0:11980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:3.0:1788666213.874913:0:11980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+19:10574:x1875552173615616:12345-192.168.201.25@tcp:49:lfs.0 00000100:00100000:3.0:1788666213.875152:0:11980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+19:10574:x1875552173615616:12345-192.168.201.25@tcp:49:lfs.0 Request processed in 237us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666213.875177:0:11980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:3.0:1788666213.875201:0:11980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:3.0:1788666213.875208:0:11980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28f365050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+18:10575:x1875552173615872:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788666213.876132:0:11980:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788666213.876256:0:11980:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:3.0:1788666213.876316:0:11980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea28b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.876335:0:11980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea28b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.876349:0:11980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea28b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.876359:0:11980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea28b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.876365:0:11980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea28b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.876372:0:11980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea28b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.876400:0:11980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788666213.876493:0:11980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28f365050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+20:10575:x1875552173615872:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 1282us (1996us total) trans 4294967408 rc 0/0 00000100:00100000:3.0:1788666213.876502:0:11980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 32 00000020:00080000:3.0:1788666213.876507:0:11980:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788666213.876568:0:7594:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666213.876604:0:7594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea28b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.876611:0:7594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ffc00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666213.876617:0:7594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea28b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.876625:0:7594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea28b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.876639:0:7594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8ab2b9e72c00) 00010000:00010000:3.0:1788666213.876642:0:7594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788666213.876649:0:7594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea28b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.876655:0:7594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea28b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.876675:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666213.876677:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666213.876679:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666213.885131:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666213.885680:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173616128 00000100:00100000:0.0:1788666213.885693:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173616128 00000100:00100000:0.0:1788666213.885796:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 128 00000100:00100000:0.0:1788666213.885810:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+20:10574:x1875552173616128:12345-192.168.201.25@tcp:58:lfs.0 00000040:00080000:0.0:1788666213.886186:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788666213.886320:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+20:10574:x1875552173616128:12345-192.168.201.25@tcp:58:lfs.0 Request processed in 512us (1204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666213.886329:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 128 00000100:00100000:2.0:1788666213.935307:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666213.935436:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173616256 00000100:00100000:1.0:1788666213.935448:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173616256 00000100:00100000:1.0:1788666213.935522:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 129 00000100:00100000:1.0:1788666213.935533:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+20:10577:x1875552173616256:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788666213.935560:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666213.935631:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea292 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a74 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.935713:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea299 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.935733:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea299 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.935747:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea299 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.935766:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea2a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.935773:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.935780:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.936076:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea2a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.936090:0:7132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea1b2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a35 expref: 21 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.936113:0:7132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea2a7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.936153:0:7132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea1b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a35 expref: 21 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666213.936169:0:7132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea1b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a35 expref: 21 pid: 7132 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666213.936184:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2905ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186210944:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788666213.936286:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab181165a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788666213.949291:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2905ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186210944:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666213.949356:0:7132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea2a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666213.962232:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666213.962363:0:11980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173616512 00000100:00100000:3.0:1788666213.962381:0:11980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173616512 00000100:00100000:3.0:1788666213.962477:0:11980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:3.0:1788666213.962489:0:11980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+22:5600:x1875552173616512:12345-192.168.201.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788666213.963290:0:11980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+23:5600:x1875552173616512:12345-192.168.201.25@tcp:35:ldlm_bl.0 Request processed in 453us (728us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1788666213.963303:0:11980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:1.0:1788666213.968843:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666213.968963:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173616640 00000100:00100000:3.0:1788666213.968988:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173616640 00010000:00010000:3.0:1788666213.969033:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea1b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a35 expref: 23 pid: 7132 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666213.969088:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00100000:3.0:1788666213.969100:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+23:2363:x1875552173616640:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666213.969118:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666213.969126:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea1b2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a35 expref: 23 pid: 7132 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.969141:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea1b2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a35 expref: 23 pid: 7132 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.969164:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea1b2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a35 expref: 23 pid: 7132 timeout: 420 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.969180:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:3.0:1788666213.969185:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea2a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.969195:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.969203:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea2a7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666213.969280:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666213.969348:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+22:2363:x1875552173616640:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 249us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666213.969368:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 59 00010000:00010000:2.0:1788666213.971242:0:7132:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.971262:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666213.971325:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788666213.971331:0:7132:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788666213.971359:0:7132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.971833:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea2a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.971853:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea299 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.971862:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea299 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.971872:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea299 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.971879:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666213.971886:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea299 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.971896:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea299 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.972460:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:2.0:1788666213.972465:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666213.972472:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea299 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.972481:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea299 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.972504:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea2a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.972511:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea2a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.972516:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea2a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.972523:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298854200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666213.972525:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea2a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.972531:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea2a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.972539:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8ab2908f2300) 00010000:00010000:2.0:1788666213.972541:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666213.972544:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea2a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.972549:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea2a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.972747:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea292 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a74 expref: 22 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.972766:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea2a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a74 expref: 21 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666213.972775:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:2.0:1788666213.972778:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666213.972780:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298854400, rc 0) 00000100:00100000:2.0:1788666213.972934:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+21:10577:x1875552173616256:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 37401us (37642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666213.972955:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 129 00000100:00100000:1.0:1788666214.410529:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666214.410565:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666214.410609:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666214.410637:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666214.410667:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173616768 00000100:00100000:1.0:1788666214.410677:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173616768 00000100:00100000:1.0:1788666214.410730:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 292 00000100:00100000:1.0:1788666214.410740:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2363:x1875552173616768:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666214.411111:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2363:x1875552173616768:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 371us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666214.411121:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 292 00000100:00100000:1.0:1788666214.411160:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173617024 00000100:00100000:1.0:1788666214.411165:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173617024 00000100:00100000:1.0:1788666214.411201:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173616896 00000100:00100000:1.0:1788666214.411218:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173616896 00000100:00100000:1.0:1788666214.411242:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 81 00000100:00100000:1.0:1788666214.411249:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173617024:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666214.411351:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905eca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173617024:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 102us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666214.411359:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 81 00000100:00100000:1.0:1788666214.411371:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 82 00000100:00100000:1.0:1788666214.411378:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173616896:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666214.411459:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173616896:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 81us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666214.411466:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 82 00000100:00100000:1.0:1788666214.411488:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173617152 00000100:00100000:1.0:1788666214.411491:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173617152 00000100:00100000:1.0:1788666214.411523:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 143 00000100:00100000:1.0:1788666214.411529:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84416489-fb20-4430-94f5-31470edbb54e+5:2363:x1875552173617152:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666214.411557:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84416489-fb20-4430-94f5-31470edbb54e+5:2363:x1875552173617152:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 28us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666214.411563:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 143 00000100:00080000:1.0:1788666214.411605:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788666214.411609:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788666214.415024:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788666214.924248:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788666214.924262:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788666214.924331:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788666214.924340:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788666214.924502:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab298b90e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875552186211072:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788666214.924634:0:11650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788666214.938401:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666214.938549:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab298b90e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875552186211072:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788666214.938554:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173617280 00000100:00100000:0.0:1788666214.938563:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173617280 00000100:00100000:0.0:1788666214.938653:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 130 00000100:00100000:0.0:1788666214.938665:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+21:10589:x1875552173617280:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788666214.938721:0:12001:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788666214.938880:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+21:10589:x1875552173617280:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 217us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666214.938890:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 130 00000100:00100000:2.0:1788666214.976013:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666214.976368:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173617536 00000100:00100000:3.0:1788666214.976504:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173617536 00000100:00100000:2.0:1788666214.976726:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 131 00000100:00100000:2.0:1788666214.976738:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+21:10589:x1875552173617536:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788666214.976766:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666214.976796:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea2ae lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a7b expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666214.976946:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea2b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666214.976964:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666214.976978:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea2b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666214.977001:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788666214.977352:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea2ae lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a7b expref: 24 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666214.977367:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea2b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a7b expref: 23 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666214.977375:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:2.0:1788666214.977520:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666214.977526:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2400, rc 0) 00000100:00100000:2.0:1788666214.977697:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+23:10589:x1875552173617536:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 959us (1702us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788666214.977706:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 131 00000100:00100000:3.0:1788666214.993377:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666214.993567:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173617792 00000100:00100000:1.0:1788666214.993604:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173617792 00000100:00100000:1.0:1788666214.993675:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 132 00000100:00100000:1.0:1788666214.993689:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+23:10589:x1875552173617792:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788666214.993816:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea2c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666214.993847:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666214.993862:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666214.994137:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea2c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666214.994146:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea2c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666214.994153:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea2c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666214.994162:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855e00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666214.994167:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea2c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666214.994175:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea2c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666214.994187:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:1.0:1788666214.994190:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788666214.994194:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea2c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666214.994199:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea2c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666214.994367:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+24:10589:x1875552173617792:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 679us (1004us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788666214.994390:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 132 00000040:00080000:3.0:1788666214.994553:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788666214.994558:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1788666214.995340:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000040:00080000:3.0:1788666214.995345:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788666214.995355:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788666214.995852:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173617920 00000100:00100000:0.0:1788666214.995862:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173617920 00000100:00100000:0.0:1788666214.995991:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:0.0:1788666214.996004:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a096dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+24:2364:x1875552173617920:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788666214.996024:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666214.996124:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea2b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a7b expref: 24 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666214.996142:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:0.0:1788666214.996147:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666214.996205:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a096dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+23:2364:x1875552173617920:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 204us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666214.996219:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:1.0:1788666215.018577:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666215.024829:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173618176 00000100:00100000:0.0:1788666215.024861:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173618176 00000100:00100000:3.0:1788666215.025078:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 34 00000100:00100000:3.0:1788666215.025099:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+23:10589:x1875552173618176:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00080000:1.0:1788666215.025505:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666215.025821:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+24:10589:x1875552173618176:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 727us (7253us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788666215.025831:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 34 00000040:00080000:2.0:1788666215.061853:0:12073:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788666215.061872:0:12073:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788666215.061943:0:12073:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788666215.061950:0:12073:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788666215.365141:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666215.365183:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173618432 00000100:00100000:3.0:1788666215.365196:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173618432 00000100:00100000:3.0:1788666215.365256:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 133 00000100:00100000:3.0:1788666215.365266:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+24:10602:x1875552173618432:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1788666215.365306:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666215.365328:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea2ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a82 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666215.365450:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea2d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666215.365467:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea2d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666215.365482:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea2d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666215.365495:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788666215.365663:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea2ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a82 expref: 27 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666215.365682:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea2d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a82 expref: 26 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666215.365691:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:3.0:1788666215.365694:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788666215.365699:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814fe600, rc 0) 00000100:00100000:3.0:1788666215.365759:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+26:10602:x1875552173618432:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 495us (629us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788666215.365766:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 133 00000100:00100000:3.0:1788666215.370260:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666215.377528:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173618560 00000100:00100000:0.0:1788666215.377561:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173618560 00000100:00100000:0.0:1788666215.377698:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 134 00000100:00100000:0.0:1788666215.377712:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+26:10602:x1875552173618560:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:0.0:1788666215.377816:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea2df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666215.377844:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea2df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666215.377863:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea2df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666215.377908:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea2df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666215.377918:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea2df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666215.377927:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea2df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666215.377935:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144aa00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666215.377940:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea2df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666215.377948:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea2df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666215.377979:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:0.0:1788666215.377983:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788666215.377989:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea2df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666215.377996:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144aa00/0x96bbe788361ea2df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666215.378124:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+26:10602:x1875552173618560:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 414us (7875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666215.378134:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 134 00000001:00080000:1.0:1788666215.396564:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1788666215.396616:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:0.0:1788666215.436544:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666215.511779:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666215.512661:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173618688 00000100:00100000:1.0:1788666215.512681:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173618688 00000100:00080000:3.0:1788666215.512957:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788666215.513102:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:0.0:1788666215.514445:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2362:x1875552173618688:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:0.0:1788666215.514472:0:6651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666215.514500:0:6651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032a76ac0/0x96bbe788361ea2e6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a89 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788666215.514532:0:6651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ce165, atime: 0x6a9ce164, ctime: 0x6a9ce165, blocks: 0xb 00010000:00010000:0.0:1788666215.514560:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=322s v=(0 0) 00010000:00010000:0.0:1788666215.514566:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788666215.514577:0:6651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032a76ac0/0x96bbe788361ea2e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a89 expref: 7 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666215.514758:0:6651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000032a76ac0/0x96bbe788361ea2e6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a89 expref: 7 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666215.514793:0:6651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144aa00, rc 0) 00000100:00100000:0.0:1788666215.514935:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+7:2362:x1875552173618688:12345-192.168.201.25@tcp:101:cat.0 Request processed in 1821us (3171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666215.514944:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:3.0:1788666215.518510:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666215.518687:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173618816 00000100:00100000:0.0:1788666215.518706:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173618816 00002000:00100000:0.0:1788666215.518789:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8ab2c1e07100 x1875552173618816/t0(0) o3->0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp:256/0 lens 488/0 e 0 to 0 dl 1788666226 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788666215.518802:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab2c1e07100 with x1875552173618816 ext(0->4095) 00002000:00010000:0.0:1788666215.518809:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab2c1e07100 00000100:00100000:0.0:1788666215.518883:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:0.0:1788666215.518894:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173618816:12345-192.168.201.25@tcp:3:cat.0 00000100:00100000:0.0:1788666215.519214:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173618816:12345-192.168.201.25@tcp:3:cat.0 Request processed in 320us (719us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788666215.519223:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 3 00002000:00100000:0.0:1788666215.519231:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8ab2c1e07100 x1875552173618816/t0(0) o3->0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp:256/0 lens 488/4536 e 0 to 0 dl 1788666226 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788666215.519239:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab2c1e07100 with x1875552173618816 ext(0->4095) 00002000:00010000:0.0:1788666215.519242:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab2c1e07100 00000100:00100000:2.0:1788666215.823281:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab298b94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186211200:0@lo:400:kworker.0 00000100:00100000:2.0:1788666215.823402:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666215.823674:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186211200 00000100:00100000:3.0:1788666215.823683:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186211200 00000100:00100000:3.0:1788666215.823746:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788666215.823757:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186211200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666215.823982:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186211200:12345-0@lo:400:kworker.0 Request processed in 226us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666215.823991:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788666215.824042:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab298b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186211328:0@lo:400:kworker.0 00000100:00100000:3.0:1788666215.824075:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666215.824164:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186211328 00000100:00100000:1.0:1788666215.824168:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186211328 00000100:00100000:1.0:1788666215.824215:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788666215.824223:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186211328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666215.824262:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186211328:12345-0@lo:400:kworker.0 Request processed in 41us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666215.824268:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788666215.824353:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab298b95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186211328:0@lo:400:kworker.0 00000100:00100000:3.0:1788666215.827238:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2905ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186211456:0@lo:400:kworker.0 00000100:00100000:3.0:1788666215.827371:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666215.827476:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186211456 00000100:00100000:0.0:1788666215.827486:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186211456 00000100:00100000:0.0:1788666215.827617:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788666215.827630:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186211456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666215.827994:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab298b94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186211200:0@lo:400:kworker.0 00000100:00100000:2.0:1788666215.828076:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab290579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186211584:0@lo:400:kworker.0 00000100:00100000:2.0:1788666215.828113:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666215.828153:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186211584 00000100:00100000:2.0:1788666215.828157:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186211584 00000100:00100000:2.0:1788666215.828207:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788666215.828214:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3278:x1875552186211584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666215.828253:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3278:x1875552186211584:12345-0@lo:400:kworker.0 Request processed in 39us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666215.828260:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788666215.828297:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab290579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186211584:0@lo:400:kworker.0 00000100:00100000:0.0:1788666215.828482:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186211456:12345-0@lo:400:kworker.0 Request processed in 855us (1122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666215.828490:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00080000:0.0:1788666215.828517:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788666215.828524:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666215.828575:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2905ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186211456:0@lo:400:kworker.0 00000100:00100000:2.0:1788666215.828857:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab290579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186211712:0@lo:400:kworker.0 00000100:00100000:2.0:1788666215.828892:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666215.828990:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186211712 00000100:00100000:3.0:1788666215.828996:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186211712 00000100:00100000:3.0:1788666215.829051:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788666215.829060:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186211712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666215.829127:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186211840:0@lo:400:kworker.0 00000100:00100000:0.0:1788666215.829160:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666215.829201:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186211840 00000100:00100000:0.0:1788666215.829205:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186211840 00000100:00100000:0.0:1788666215.829236:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788666215.829244:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186211840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666215.829282:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186211840:12345-0@lo:400:kworker.0 Request processed in 40us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666215.829289:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788666215.829314:0:3276:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788666215.829320:0:3276:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1788666215.829338:0:3276:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab2905eea00, transno 4294967304 00000100:00100000:0.0:1788666215.829350:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186211840:0@lo:400:kworker.0 00000100:00100000:3.0:1788666215.829865:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186211712:12345-0@lo:400:kworker.0 Request processed in 805us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666215.829874:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00080000:3.0:1788666215.829895:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788666215.829899:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666215.829948:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab290579c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186211712:0@lo:400:kworker.0 00000040:00080000:3.0:1788666216.011240:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788666216.011251:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788666216.011283:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788666216.011310:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788666216.334782:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788666216.334817:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2905eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186211968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788666216.334935:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666216.335038:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186211968 00000100:00100000:3.0:1788666216.335050:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186211968 00000100:00100000:3.0:1788666216.335115:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788666216.335139:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186211968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788666216.335193:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666216.335251:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186211968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666216.335259:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788666216.335320:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2905eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186211968:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788666216.458919:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666217.356788:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2905eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186212096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788666217.356904:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666217.357324:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186212096 00000100:00100000:3.0:1788666217.357337:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186212096 00000100:00100000:3.0:1788666217.357432:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788666217.357444:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3278:x1875552186212096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788666217.357488:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666217.357553:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3278:x1875552186212096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666217.357563:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788666217.357674:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2905eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186212096:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788666217.357812:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788666217.494402:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666218.510006:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788666218.971653:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1788666218.971675:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1788666218.978982:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000020:00080000:3.0:1788666218.979005:0:5830:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:3.0:1788666218.979025:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:0.0:1788666218.979032:0:5841:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1788666218.979044:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1788666218.979050:0:5841:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:3.0:1788666218.979071:0:5830:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab290495240 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1788666218.979082:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab290508e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab290495cc0 00000020:00080000:3.0:1788666218.979086:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab290508c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab2bfaffc00 00000020:00080000:0.0:1788666218.979104:0:5841:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788666218.979444:0:5841:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1788666219.534067:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666219.534112:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666219.534137:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173619200 00000100:00100000:0.0:1788666219.534149:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173619200 00000100:00100000:0.0:1788666219.534226:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 85 00000100:00100000:0.0:1788666219.534236:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173619200:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666219.534309:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173619200:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 74us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666219.534317:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 85 00000100:00080000:0.0:1788666219.534340:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788666219.534371:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666219.534514:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666219.534539:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666219.534564:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173619456 00000100:00100000:0.0:1788666219.534568:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173619456 00000100:00100000:0.0:1788666219.534631:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173619072 00000100:00100000:0.0:1788666219.534634:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173619072 00000100:00100000:0.0:1788666219.535054:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 147 00000100:00100000:0.0:1788666219.535066:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84416489-fb20-4430-94f5-31470edbb54e+5:2363:x1875552173619456:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666219.535123:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84416489-fb20-4430-94f5-31470edbb54e+5:2363:x1875552173619456:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 61us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666219.535131:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 147 00000100:00100000:0.0:1788666219.535150:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 148 00000100:00100000:0.0:1788666219.535156:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+13:2363:x1875552173619072:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666219.535192:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+13:2363:x1875552173619072:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 36us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666219.535212:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 148 00000100:00100000:0.0:1788666219.535233:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173619328 00000100:00100000:0.0:1788666219.535238:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173619328 00000100:00100000:0.0:1788666219.535264:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 86 00000100:00100000:0.0:1788666219.535271:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+5:2363:x1875552173619328:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666219.535301:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+5:2363:x1875552173619328:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 30us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666219.535307:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 86 00000100:00080000:0.0:1788666219.535328:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788666219.535332:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788666219.535671:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666219.535905:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173618944 00000100:00100000:1.0:1788666219.535912:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173618944 00000100:00100000:1.0:1788666219.535961:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 294 00000100:00100000:1.0:1788666219.535969:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2363:x1875552173618944:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666219.536115:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2363:x1875552173618944:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 146us (2062us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666219.536122:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 294 00010000:00010000:2.0:1788666220.562750:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666220.938942:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186212224:0@lo:400:kworker.0 00000100:00100000:2.0:1788666220.939061:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666220.939243:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186212224 00000100:00100000:1.0:1788666220.939253:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186212224 00000100:00100000:1.0:1788666220.939328:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788666220.939339:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186212224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666220.943069:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186212224:12345-0@lo:400:kworker.0 Request processed in 3698us (3973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666220.943094:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788666220.943728:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186212224:0@lo:400:kworker.0 00000100:00100000:2.0:1788666220.943756:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788666220.943767:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186212352:0@lo:400:kworker.0 00000100:00100000:2.0:1788666220.944042:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666220.945186:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186212352 00000100:00100000:2.0:1788666220.945203:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186212352 00000100:00100000:2.0:1788666220.945935:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788666220.945958:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186212352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666220.946193:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788666220.946213:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186212480:0@lo:400:kworker.0 00000100:00100000:2.0:1788666220.946731:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186212352:12345-0@lo:400:kworker.0 Request processed in 781us (2688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666220.946743:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788666220.950383:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186212352:0@lo:400:kworker.0 00000100:00100000:3.0:1788666220.952222:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788666220.952295:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666220.952714:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186212736:0@lo:400:kworker.0 00000100:00100000:1.0:1788666220.952777:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666220.952857:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186212864:0@lo:400:kworker.0 00000100:00100000:1.0:1788666220.952888:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666220.953315:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186212864 00000100:00100000:0.0:1788666220.953324:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186212864 00000100:00100000:0.0:1788666220.953389:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788666220.953407:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186212864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666220.953594:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae508e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186212864:12345-0@lo:400:kworker.0 Request processed in 67us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666220.953603:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1788666220.953626:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788666220.954177:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186212480 00000100:00100000:2.0:1788666220.954191:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186212480 00000100:00100000:2.0:1788666220.954240:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186212736 00000100:00100000:2.0:1788666220.954243:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186212736 00000100:00100000:2.0:1788666220.954268:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788666220.954276:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186212480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666220.954362:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186212480:12345-0@lo:400:kworker.0 Request processed in 88us (2072us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666220.954368:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788666220.954384:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788666220.954390:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186212736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666220.954439:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186212736:12345-0@lo:400:kworker.0 Request processed in 50us (1662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666220.954446:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00080000:2.0:1788666220.954462:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666220.954512:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186212480:0@lo:400:kworker.0 00000100:00100000:1.0:1788666220.956127:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae509c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186212864:0@lo:400:kworker.0 00000100:00100000:1.0:1788666220.956167:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186212736:0@lo:400:kworker.0 00000100:00100000:3.0:1788666220.958228:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186212608:0@lo:400:kworker.0 00000100:00100000:3.0:1788666220.959209:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666220.971111:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186212608 00000100:00100000:1.0:1788666220.971132:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186212608 00000100:00100000:1.0:1788666220.971261:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788666220.971942:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186212608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666220.972455:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186212608:12345-0@lo:400:kworker.0 Request processed in 1182us (13247us total) trans 0 rc 0/0 00000100:00080000:2.0:1788666220.972821:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788666220.973016:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788666220.977562:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1788666220.977599:0:3277:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab2c1e05180, transno 4294967310 00000004:00080000:3.0:1788666220.977633:0:3277:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1788666220.977664:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186212608:0@lo:400:kworker.0 00000100:00100000:3.0:1788666221.452872:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788666221.452902:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186212992:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788666221.453016:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666221.453100:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186212992 00000100:00100000:3.0:1788666221.453108:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186212992 00000100:00100000:3.0:1788666221.453158:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788666221.453168:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c19cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186212992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788666221.453207:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666221.453255:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c19cc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186212992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666221.453263:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788666221.453541:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1e05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186212992:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788666221.578976:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666221.732699:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666221.734248:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173619584 00000100:00100000:2.0:1788666221.734267:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173619584 00000100:00080000:0.0:1788666221.734354:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666221.734369:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 135 00000100:00100000:2.0:1788666221.734383:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+13:10254:x1875552173619584:12345-192.168.201.25@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788666221.734512:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+13:10254:x1875552173619584:12345-192.168.201.25@tcp:60:lhsmtool_posix.0 Request processed in 133us (1824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666221.734520:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 135 00000100:00100000:3.0:1788666221.744532:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666221.744768:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173619840 00000100:00100000:1.0:1788666221.744780:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173619840 00000100:00100000:1.0:1788666221.744845:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00100000:1.0:1788666221.744855:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+13:10254:x1875552173619840:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788666221.745323:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+14:10254:x1875552173619840:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 466us (799us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788666221.745333:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00100000:3.0:1788666221.987778:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666221.988100:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173619968 00000100:00100000:2.0:1788666221.988114:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173619968 00000100:00100000:2.0:1788666221.988221:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 136 00000100:00100000:2.0:1788666221.988250:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84416489-fb20-4430-94f5-31470edbb54e+5:11054:x1875552173619968:12345-192.168.201.25@tcp:101:lsof.0 00000100:00080000:0.0:1788666221.988355:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788666221.988459:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666221.988491:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea2ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a90 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666221.988647:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea2f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666221.988663:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666221.988678:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666221.988720:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788666221.988724:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788666221.988768:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666221.988795:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea2ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a90 expref: 7 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666221.988817:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea2f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a90 expref: 6 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666221.988826:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2a088e000) 00010000:00010000:2.0:1788666221.988829:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788666221.988834:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f3600, rc 0) 00000100:00100000:2.0:1788666221.988923:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84416489-fb20-4430-94f5-31470edbb54e+6:11054:x1875552173619968:12345-192.168.201.25@tcp:101:lsof.0 Request processed in 676us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666221.988940:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 136 00000100:00100000:1.0:1788666222.474933:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788666222.474962:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1b7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186213120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788666222.475049:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666222.475176:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186213120 00000100:00100000:3.0:1788666222.475187:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186213120 00000100:00100000:3.0:1788666222.475278:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788666222.475289:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186213120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788666222.475328:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666222.475381:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae509c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186213120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666222.475389:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1788666222.475445:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788666222.475453:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1b7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186213120:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788666222.603017:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666223.629150:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788666224.102320:0:5830:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:0.0:1788666224.102355:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1788666224.102425:0:5841:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788666224.102440:0:5841:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788666224.646707:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666224.646757:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666224.646794:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666224.646824:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666224.646856:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666224.646928:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173620608 00000100:00100000:3.0:1788666224.646940:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173620608 00000100:00100000:3.0:1788666224.647000:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173620224 00000100:00100000:3.0:1788666224.647003:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173620224 00000100:00100000:3.0:1788666224.647028:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 152 00000100:00100000:3.0:1788666224.647038:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84416489-fb20-4430-94f5-31470edbb54e+6:2364:x1875552173620608:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666224.647124:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84416489-fb20-4430-94f5-31470edbb54e+6:2364:x1875552173620608:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 87us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666224.647131:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 152 00000100:00100000:3.0:1788666224.647149:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 153 00000100:00100000:3.0:1788666224.647155:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+13:2364:x1875552173620224:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666224.647184:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+13:2364:x1875552173620224:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 30us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666224.647190:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 153 00000100:00100000:3.0:1788666224.647241:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173620352 00000100:00100000:3.0:1788666224.647245:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173620352 00000100:00100000:3.0:1788666224.647269:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173620480 00000100:00100000:3.0:1788666224.647271:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173620480 00000100:00100000:3.0:1788666224.647290:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 89 00000100:00100000:3.0:1788666224.647296:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173620352:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666224.647324:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173620352:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 29us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666224.647330:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 89 00000100:00100000:3.0:1788666224.647339:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 90 00000100:00100000:3.0:1788666224.647345:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+5:2364:x1875552173620480:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666224.647366:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+5:2364:x1875552173620480:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 21us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666224.647371:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 90 00000100:00080000:3.0:1788666224.647498:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788666224.647503:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788666224.647509:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788666224.651159:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173620096 00000100:00100000:1.0:1788666224.651182:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173620096 00000100:00100000:1.0:1788666224.651288:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 296 00000100:00100000:1.0:1788666224.651302:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2862e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173620096:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666224.651407:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2862e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173620096:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 109us (4712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666224.651416:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 296 00010000:00010000:2.0:1788666224.659339:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666225.675929:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666226.059071:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186213504:0@lo:400:kworker.0 00000100:00100000:3.0:1788666226.059151:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666226.059225:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788666226.059232:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186213632:0@lo:400:kworker.0 00000100:00100000:3.0:1788666226.059260:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666226.059296:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186213504 00000100:00100000:3.0:1788666226.059304:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186213504 00000100:00100000:3.0:1788666226.059365:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788666226.059375:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186213504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666226.059431:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186213504:12345-0@lo:400:kworker.0 Request processed in 58us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666226.059454:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788666226.059481:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186213632 00000100:00100000:3.0:1788666226.059486:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186213632 00000100:00100000:3.0:1788666226.059510:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788666226.059516:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186213632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666226.059546:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae726680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186213632:12345-0@lo:400:kworker.0 Request processed in 31us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666226.059552:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:3.0:1788666226.059568:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788666226.059573:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666226.060080:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186213632:0@lo:400:kworker.0 00000100:00100000:3.0:1788666226.060091:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186213504:0@lo:400:kworker.0 00000100:00100000:1.0:1788666226.060193:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186213248:0@lo:400:kworker.0 00000100:00100000:1.0:1788666226.060239:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666226.060279:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186213760:0@lo:400:kworker.0 00000100:00100000:1.0:1788666226.060302:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666226.060324:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788666226.060330:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186213376:0@lo:400:kworker.0 00000100:00100000:1.0:1788666226.060350:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666226.060365:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186213888:0@lo:400:kworker.0 00000100:00100000:1.0:1788666226.060382:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666226.060486:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186213888 00000100:00100000:1.0:1788666226.060490:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186213888 00000100:00100000:1.0:1788666226.060525:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788666226.060532:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186213888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666226.060571:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186213888:12345-0@lo:400:kworker.0 Request processed in 39us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666226.060610:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788666226.060627:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186213760 00000100:00100000:1.0:1788666226.060630:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186213760 00000100:00100000:1.0:1788666226.060651:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186213376 00000100:00100000:1.0:1788666226.060653:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186213376 00000100:00100000:1.0:1788666226.060667:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788666226.060672:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186213760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666226.060699:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae50aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186213760:12345-0@lo:400:kworker.0 Request processed in 27us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666226.060704:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788666226.060713:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788666226.060718:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186213376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666226.060860:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae50a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186213376:12345-0@lo:400:kworker.0 Request processed in 141us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666226.060866:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1788666226.060958:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788666226.060961:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788666226.061075:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186213376:0@lo:400:kworker.0 00000100:00100000:1.0:1788666226.061084:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186213888:0@lo:400:kworker.0 00000100:00100000:1.0:1788666226.061092:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186213760:0@lo:400:kworker.0 00000100:00100000:3.0:1788666226.061173:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186213248 00000100:00100000:3.0:1788666226.061178:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186213248 00000100:00100000:3.0:1788666226.061226:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788666226.061232:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186213248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666226.061272:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290466850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186213248:12345-0@lo:400:kworker.0 Request processed in 41us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666226.061278:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1788666226.062660:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186213248:0@lo:400:kworker.0 00000040:00080000:3.0:1788666226.264125:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788666226.264140:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788666226.272052:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1788666226.272070:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:02000400:1.0:1788666226.311722:0:12277:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 23:43:44 (1788666224) 00000100:00100000:0.0:1788666226.572430:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186214016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788666226.572501:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666226.572575:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186214016 00000100:00100000:0.0:1788666226.572601:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186214016 00000100:00100000:0.0:1788666226.572649:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788666226.572659:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186214016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788666226.572696:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666226.574057:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186214016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1393us (1549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666226.574072:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788666226.574137:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa62a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186214016:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788666226.703883:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666227.595883:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186214144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788666227.596023:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666227.596503:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186214144 00000100:00100000:2.0:1788666227.596512:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186214144 00000100:00100000:2.0:1788666227.596607:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788666227.596617:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186214144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788666227.596657:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666227.605473:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa62a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186214144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8842us (9439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666227.605491:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788666227.608677:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186214144:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788666227.722927:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666227.729996:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666227.730189:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173620864 00000100:00100000:0.0:1788666227.730201:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173620864 00000100:00080000:1.0:1788666227.730359:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666227.730412:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 137 00000100:00100000:0.0:1788666227.730424:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+13:11320:x1875552173620864:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788666227.730448:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666227.730471:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea2fb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a97 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.730547:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea302 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.730614:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea302 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.730629:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea302 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.730647:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea309 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.730655:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea309 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.730662:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea309 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.730948:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea310 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.730960:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea310 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.730968:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea310 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666227.730982:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788666227.731137:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea302 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.731147:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea302 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.731156:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea302 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.731169:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144b400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666227.731174:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea302 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.731183:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea302 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.731199:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ab2a088ea00) 00010000:00010000:0.0:1788666227.731202:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666227.731209:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea302 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.731216:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea302 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.731231:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea309 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.731238:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea309 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.731246:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea309 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.731252:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144a800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666227.731255:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea309 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.731408:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea309 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.731429:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ab290a48300) 00010000:00010000:0.0:1788666227.731432:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666227.731435:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea309 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.731442:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea309 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.731963:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea2fb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a97 expref: 16 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.731980:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea310 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a97 expref: 15 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.731990:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab2908f2b00) 00010000:00010000:0.0:1788666227.731992:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666227.731995:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144b800, rc 0) 00000100:00100000:0.0:1788666227.732078:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae725880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+15:11320:x1875552173620864:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 1655us (2094us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788666227.732087:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 137 00000100:00100000:1.0:1788666227.742638:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666227.745254:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173620992 00000100:00100000:2.0:1788666227.745278:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173620992 00000100:00100000:2.0:1788666227.745467:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 138 00000100:00100000:2.0:1788666227.745824:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+15:11320:x1875552173620992:12345-192.168.201.25@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788666227.746049:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+15:11320:x1875552173620992:12345-192.168.201.25@tcp:59:lhsmtool_posix.0 Request processed in 243us (3426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666227.746059:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 138 00000100:00100000:3.0:1788666227.752943:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666227.753268:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173621120 00000100:00100000:0.0:1788666227.753281:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173621120 00000100:00100000:0.0:1788666227.753359:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:0.0:1788666227.753370:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae726d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+15:2362:x1875552173621120:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788666227.753401:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666227.753433:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea310 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a97 expref: 15 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666227.753481:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab2908f2b00) 00010000:00010000:0.0:1788666227.753488:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666227.753571:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae726d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+14:2362:x1875552173621120:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 202us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666227.753626:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000040:00080000:0.0:1788666228.299691:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788666228.299702:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788666228.304611:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:0.0:1788666228.304641:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788666228.761352:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788666229.229945:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:0.0:1788666229.771416:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666229.771656:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666229.771701:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666229.771740:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666229.771755:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173621632 00000100:00100000:1.0:1788666229.771764:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666229.771767:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173621632 00000100:00100000:1.0:1788666229.771811:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666229.771839:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173621504 00000100:00100000:1.0:1788666229.771845:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173621504 00000100:00100000:0.0:1788666229.771862:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 93 00000100:00100000:0.0:1788666229.771876:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+5:2364:x1875552173621632:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666229.771887:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 94 00000100:00100000:1.0:1788666229.771899:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173621504:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666229.771966:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+5:2364:x1875552173621632:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 93us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666229.771974:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 93 00000100:00080000:0.0:1788666229.771999:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788666229.772003:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788666229.772322:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173621376 00000100:00100000:3.0:1788666229.772328:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173621376 00000100:00100000:3.0:1788666229.772375:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173621760 00000100:00100000:3.0:1788666229.772379:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173621760 00000100:00100000:3.0:1788666229.772407:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 157 00000100:00100000:3.0:1788666229.772416:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+13:2364:x1875552173621376:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666229.772423:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 158 00000100:00100000:0.0:1788666229.772434:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84416489-fb20-4430-94f5-31470edbb54e+6:2364:x1875552173621760:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666229.778162:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173621504:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 6248us (6379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666229.778180:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 94 00000100:00100000:3.0:1788666229.780013:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+13:2364:x1875552173621376:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 7582us (8348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666229.780022:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290505880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:84416489-fb20-4430-94f5-31470edbb54e+6:2364:x1875552173621760:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 7586us (8206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666229.780038:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 157 00000100:00080000:3.0:1788666229.780110:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666229.780260:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 158 00000100:00100000:2.0:1788666229.780381:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173621248 00000100:00100000:2.0:1788666229.780393:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173621248 00000100:00100000:2.0:1788666229.780462:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 298 00000100:00100000:2.0:1788666229.780474:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173621248:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666229.780728:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290464450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173621248:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 110us (8840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666229.780738:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 298 00000100:00100000:1.0:1788666230.115487:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666230.116273:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173621888 00000100:00100000:2.0:1788666230.116285:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173621888 00000100:00100000:2.0:1788666230.116357:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 139 00000100:00100000:2.0:1788666230.116368:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+13:11362:x1875552173621888:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666230.116395:0:12001:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666230.116424:0:12001:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea31e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42a9e expref: -99 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.116507:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea325 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.116525:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea325 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.116537:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea325 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.116548:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea32c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.116553:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea32c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.116558:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea32c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.116802:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea325 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.116821:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea325 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.116828:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea325 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.116835:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666230.116840:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea325 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.116848:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea325 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.116862:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2a088e000) 00010000:00010000:2.0:1788666230.116865:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666230.116871:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea325 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.116876:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea325 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.116891:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea32c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.116896:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea32c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.116902:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea32c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.116907:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3e00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666230.116916:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea32c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.116922:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea32c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.116929:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ab2a088e300) 00010000:00010000:2.0:1788666230.116932:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666230.116934:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea32c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.116940:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea32c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.116976:0:12001:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea31e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a9e expref: 14 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.116986:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2a088e000) 00010000:00010000:2.0:1788666230.116988:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666230.116992:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea31e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a9e expref: 14 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.117002:0:12001:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2e00, rc 0) 00000100:00100000:2.0:1788666230.117073:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290506a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+13:11362:x1875552173621888:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 707us (1599us total) trans 0 rc 301/301 00000100:00100000:2.0:1788666230.117081:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 139 00000100:00100000:1.0:1788666230.129282:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666230.129470:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173622144 00000100:00100000:3.0:1788666230.129482:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173622144 00000100:00100000:3.0:1788666230.129553:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 140 00000100:00100000:3.0:1788666230.129564:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+13:11362:x1875552173622144:12345-192.168.201.25@tcp:36:lfs.0 00010000:00010000:3.0:1788666230.129657:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666230.129709:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361e9c9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428d7 expref: 13 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.129733:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2a088e000) 00010000:00010000:3.0:1788666230.129741:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788666230.130063:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea333 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.130079:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea2f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a90 expref: 5 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.130090:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea333 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.130418:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea2f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a90 expref: 5 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.130435:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea2f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a90 expref: 5 pid: 5808 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666230.130456:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaac700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875552186214272:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788666230.130628:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2ae21b180 going to sleep for 11 seconds 00000100:00100000:1.0:1788666230.136052:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666230.136092:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173622272 00000100:00100000:1.0:1788666230.136104:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173622272 00010000:00010000:1.0:1788666230.136165:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea2f4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a90 expref: 6 pid: 5808 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666230.136203:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:1.0:1788666230.136213:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290507b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84416489-fb20-4430-94f5-31470edbb54e+6:2363:x1875552173622272:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666230.136233:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666230.136241:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea2f4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a90 expref: 6 pid: 5808 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.136274:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea2f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a90 expref: 6 pid: 5808 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.136300:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2a088e000) 00010000:00010000:1.0:1788666230.136307:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea333 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.136319:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea333 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.136327:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea333 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.136348:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666230.136419:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290507b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:84416489-fb20-4430-94f5-31470edbb54e+6:2363:x1875552173622272:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 207us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666230.136427:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 60 00010000:00010000:3.0:1788666230.137792:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea2f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a90 expref: 5 pid: 5808 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666230.137821:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaac700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875552186214272:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788666230.137843:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea333 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.137853:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea333 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.137858:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea333 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.137889:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea33a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.137903:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea33a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.137914:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea33a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666230.141436:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788666230.141459:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea333 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.141470:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea333 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.141478:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea333 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.141485:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ffc00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666230.141490:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea333 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.141497:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea333 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.141515:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2a088e000) 00010000:00010000:3.0:1788666230.141518:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666230.141524:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea333 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.141532:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea333 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788666230.141554:0:5808:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4b85a37 reply state 000000000926f566 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea33a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666230.141566:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788666230.141712:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290504a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+14:11362:x1875552173622144:12345-192.168.201.25@tcp:36:lfs.0 Request processed in 12145us (12435us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788666230.141733:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 140 00010000:00010000:0.0:1788666230.148489:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea33a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666230.148525:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea33a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666230.148533:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea33a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666230.148540:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814fe400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666230.148546:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea33a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666230.148555:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea33a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666230.148575:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ab2b9e72500) 00010000:00010000:0.0:1788666230.148612:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666230.148619:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea33a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666230.148625:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea33a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666230.256879:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666230.257029:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173622400 00000100:00100000:0.0:1788666230.257044:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173622400 00000100:00100000:0.0:1788666230.257111:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 141 00000100:00100000:0.0:1788666230.257123:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+13:11370:x1875552173622400:12345-192.168.201.25@tcp:101:lctl.0 00010000:00010000:0.0:1788666230.257151:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666230.257181:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea341 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42aa5 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666230.257314:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea348 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666230.257332:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea348 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666230.257345:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea348 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666230.257475:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788666230.257480:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788666230.257506:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea348 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666230.257535:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea341 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42aa5 expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666230.257554:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea348 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42aa5 expref: 14 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666230.257565:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab290a48300) 00010000:00010000:0.0:1788666230.257569:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788666230.257576:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144b400, rc 0) 00000100:00100000:0.0:1788666230.257758:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290504e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+14:11370:x1875552173622400:12345-192.168.201.25@tcp:101:lctl.0 Request processed in 635us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666230.257781:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 141 00000100:00100000:3.0:1788666230.316995:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666230.317299:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173622528 00000100:00100000:1.0:1788666230.317312:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173622528 00000100:00100000:1.0:1788666230.317406:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 142 00000100:00100000:1.0:1788666230.317417:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+14:11376:x1875552173622528:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788666230.317443:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666230.317465:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854c00/0x96bbe788361ea34f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42aac expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.317535:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea356 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.317565:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea356 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.317614:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea356 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.317647:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea35d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.317662:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea35d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.317670:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea35d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.317829:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea364 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.317838:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.317845:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666230.317875:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788666230.317880:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788666230.317899:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea364 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.317911:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea356 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.317927:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea356 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.317933:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea356 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.317939:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855e00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666230.317943:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea356 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.317951:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea356 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.317965:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab290a48300) 00010000:00010000:1.0:1788666230.317968:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666230.317974:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea356 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.317981:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea356 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.317994:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea35d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.318001:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea35d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.318007:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea35d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.318012:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666230.318022:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea35d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.318029:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea35d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.318038:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8ab2908f2c00) 00010000:00010000:1.0:1788666230.318040:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666230.318043:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea35d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.318050:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea35d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.318081:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854c00/0x96bbe788361ea34f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42aac expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.318094:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea364 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42aac expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.318101:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:1.0:1788666230.318103:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788666230.318105:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855a00, rc 0) 00000100:00100000:1.0:1788666230.318172:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+15:11376:x1875552173622528:12345-192.168.201.25@tcp:101:bash.0 Request processed in 755us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666230.318179:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 142 00000100:00100000:0.0:1788666230.338521:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666230.338700:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173622784 00000100:00100000:3.0:1788666230.338716:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173622784 00000100:00100000:3.0:1788666230.338799:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 143 00000100:00100000:3.0:1788666230.338819:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+15:11376:x1875552173622784:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1788666230.338853:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666230.338879:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea36b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42ab3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.339057:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea372 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.339076:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea372 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.339095:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea372 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.339264:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea379 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.339273:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea379 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.339280:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea379 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788666230.342099:0:5808:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788666230.342347:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea380 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.344221:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.344240:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.344427:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea372 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.344434:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea372 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.344442:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea372 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.344446:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666230.344451:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea372 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.344458:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea372 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.344469:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:2.0:1788666230.344471:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666230.344476:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea372 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.344480:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea372 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788666230.344496:0:5808:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009990554f reply state 00000000d2913bdb transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea379 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666230.344517:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788666230.344595:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea36b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ab3 expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.344615:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ab3 expref: 17 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.344623:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2a088e300) 00010000:00010000:2.0:1788666230.344625:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666230.344627:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f3e00, rc 0) 00000100:00100000:2.0:1788666230.344744:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+18:11376:x1875552173622784:12345-192.168.201.25@tcp:101:bash.0 Request processed in 5933us (6236us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788666230.344754:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 143 00010000:00010000:3.0:1788666230.349068:0:3261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea379 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.349130:0:3261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea379 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.349139:0:3261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea379 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.349146:0:3261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff000 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666230.349152:0:3261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea379 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.349161:0:3261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea379 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.349183:0:3261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab2b9e72b00) 00010000:00010000:3.0:1788666230.349187:0:3261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666230.349193:0:3261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea379 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.349201:0:3261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea379 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666230.350264:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666230.350342:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173622912 00000100:00100000:3.0:1788666230.350353:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173622912 00000100:00100000:3.0:1788666230.350426:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:3.0:1788666230.350437:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+5:2363:x1875552173622912:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1788666230.350457:0:6649:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666230.350475:0:6649:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea38e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42aba expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788666230.350537:0:6649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788666230.350563:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=337s v=(0 0) 00010000:00010000:3.0:1788666230.350569:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666230.350612:0:6649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea38e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42aba expref: 6 pid: 6649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.350633:0:6649:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea38e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42aba expref: 6 pid: 6649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.350648:0:6649:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814ff200, rc 0) 00000100:00100000:3.0:1788666230.350730:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173622912:12345-192.168.201.25@tcp:101:bash.0 Request processed in 294us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666230.350739:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:2.0:1788666230.354206:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666230.355179:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173623040 00000100:00100000:1.0:1788666230.355194:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173623040 00000100:00100000:1.0:1788666230.355387:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:1.0:1788666230.355400:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+6:11376:x1875552173623040:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788666230.355450:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666230.355479:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea395 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42ac1 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.355524:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea38e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42aba expref: 7 pid: 6649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.355535:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666230.355539:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666230.355545:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea395 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ac1 expref: 7 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.355626:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea38e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42aba expref: 7 pid: 6649 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.355642:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea38e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42aba expref: 7 pid: 6649 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666230.355667:0:8429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab290505180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8429:1875552186214400:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788666230.355832:0:8429:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29a089000 going to sleep for 11 seconds 00000100:00100000:1.0:1788666230.366153:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666230.366397:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173623168 00000100:00100000:3.0:1788666230.366410:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173623168 00010000:00010000:3.0:1788666230.366462:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea38e lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42aba expref: 8 pid: 6649 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666230.366504:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:2.0:1788666230.366510:0:8429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab290505180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8429:1875552186214400:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788666230.366516:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290507800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+8:2363:x1875552173623168:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666230.366536:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666230.366557:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea395 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ac1 expref: 8 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.366569:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea38e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42aba expref: 8 pid: 6649 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.366639:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855200, rc 0) 00010000:00010000:3.0:1788666230.366645:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea38e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42aba expref: 8 pid: 6649 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666230.366735:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+8:11376:x1875552173623040:12345-192.168.201.25@tcp:101:bash.0 Request processed in 11336us (12542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666230.366743:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 49 00010000:00010000:3.0:1788666230.366810:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000194f020e/0x96bbe788361ea38e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42aba expref: 7 pid: 6649 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.366826:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666230.366830:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666230.366837:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea395 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ac1 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.366846:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea395 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ac1 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.366879:0:5793:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea395 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ac1 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666230.366890:0:5793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaafb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5793:1875552186214528:192.168.201.25@tcp:105: 00000100:00100000:3.0:1788666230.366942:0:5793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2ae21b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788666230.372681:0:5793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaafb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5793:1875552186214528:192.168.201.25@tcp:105: 00010000:00010000:3.0:1788666230.372720:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666230.372832:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290507800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173623168:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 6306us (6677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666230.372846:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:0.0:1788666230.379452:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666230.380143:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173623424 00000100:00100000:1.0:1788666230.380153:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173623424 00000100:00100000:1.0:1788666230.380228:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:1.0:1788666230.380241:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+17:11376:x1875552173623424:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:1.0:1788666230.383490:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+18:11376:x1875552173623424:12345-192.168.201.25@tcp:35:bash.0 Request processed in 3236us (4041us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788666230.383525:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:0.0:1788666230.511704:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666230.511910:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173623680 00000100:00100000:2.0:1788666230.511926:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173623680 00000100:00100000:2.0:1788666230.512011:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 144 00000100:00100000:2.0:1788666230.512024:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+18:11386:x1875552173623680:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666230.512083:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666230.512131:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea39c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42ac8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666230.512266:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788666230.512429:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea39c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ac8 expref: 20 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.512447:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab290a48300) 00010000:00010000:2.0:1788666230.512451:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788666230.512458:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea39c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ac8 expref: 20 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.512476:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2800, rc 0) 00000100:00100000:2.0:1788666230.512549:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+19:11386:x1875552173623680:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 527us (863us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1788666230.512557:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 144 00000100:00100000:0.0:1788666230.519101:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666230.520425:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173623936 00000100:00100000:1.0:1788666230.520443:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173623936 00000100:00100000:1.0:1788666230.520522:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00100000:1.0:1788666230.520533:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+19:11386:x1875552173623936:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:1.0:1788666230.521553:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+20:11386:x1875552173623936:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 1012us (2455us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788666230.521566:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00100000:0.0:1788666230.622145:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666230.622261:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173624064 00000100:00100000:1.0:1788666230.622272:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173624064 00000100:00100000:1.0:1788666230.622338:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 145 00000100:00100000:1.0:1788666230.622348:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+20:11392:x1875552173624064:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788666230.622372:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666230.622409:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea3aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42acf expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.622479:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea3b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.622494:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.622506:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666230.622546:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788666230.622551:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788666230.622629:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.622661:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea3aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42acf expref: 22 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.622683:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea3b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42acf expref: 21 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.622693:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:1.0:1788666230.622696:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788666230.622701:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855800, rc 0) 00000100:00100000:1.0:1788666230.622778:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+21:11392:x1875552173624064:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 431us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666230.622785:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 145 00000100:00100000:0.0:1788666230.625780:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666230.625871:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173624320 00000100:00100000:2.0:1788666230.625882:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173624320 00000100:00100000:2.0:1788666230.625952:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 146 00000100:00100000:2.0:1788666230.625964:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+21:11392:x1875552173624320:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666230.625988:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666230.626011:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea3b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42ad6 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.626135:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea3bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.626163:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea3bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.626176:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea3bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666230.626190:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788666230.626337:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea3b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ad6 expref: 24 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.626358:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea3bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ad6 expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.626366:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2a088e300) 00010000:00010000:2.0:1788666230.626369:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666230.626372:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2400, rc 0) 00000100:00100000:2.0:1788666230.626456:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+23:11392:x1875552173624320:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 493us (693us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788666230.626464:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 146 00000100:00100000:0.0:1788666230.635629:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666230.636042:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173624576 00000100:00100000:3.0:1788666230.636054:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173624576 00000100:00100000:3.0:1788666230.636131:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 147 00000100:00100000:3.0:1788666230.636143:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+23:11392:x1875552173624576:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1788666230.636785:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666230.636813:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea3cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42add expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.636946:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea3d4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.636978:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea3d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.636992:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea3d4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666230.637006:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788666230.637151:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea3cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42add expref: 26 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.637324:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea3d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42add expref: 25 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.637335:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2a088e300) 00010000:00010000:3.0:1788666230.637338:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788666230.637342:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814ff000, rc 0) 00000100:00100000:3.0:1788666230.637437:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+25:11392:x1875552173624576:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1294us (1860us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788666230.637469:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 147 00000100:00100000:1.0:1788666230.645477:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666230.646515:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173624704 00000100:00100000:0.0:1788666230.646531:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173624704 00000100:00100000:0.0:1788666230.646650:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:0.0:1788666230.646662:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290505180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+25:2363:x1875552173624704:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788666230.646685:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666230.646715:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea3bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ad6 expref: 25 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666230.646743:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2a088e300) 00010000:00010000:0.0:1788666230.646748:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666230.646847:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290505180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+24:2363:x1875552173624704:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 187us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666230.646856:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:0.0:1788666230.659037:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666230.659133:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173624832 00000100:00100000:1.0:1788666230.659144:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173624832 00000100:00100000:1.0:1788666230.659199:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:1.0:1788666230.659208:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:2362:x1875552173624832:12345-192.168.201.25@tcp:1:lfs.0 00010000:00010000:1.0:1788666230.659255:0:6651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000032da61c/0x96bbe788361ea3e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.659276:0:6651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea395 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ac1 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.659285:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666230.659290:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788666230.659308:0:6651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000032da61c/0x96bbe788361ea3e2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.659351:0:6651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea395 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ac1 expref: 6 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.659366:0:6651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea395 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ac1 expref: 6 pid: 8429 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666230.659382:0:6651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae794380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6651:1875552186214656:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788666230.659471:0:6651:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29a089000 going to sleep for 11 seconds 00000100:00100000:3.0:1788666230.674361:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666230.674535:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173624960 00000100:00100000:2.0:1788666230.674551:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173624960 00002000:00100000:2.0:1788666230.674639:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8ab2bfaafb80 x1875552173624960/t0(0) o4->0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp:271/0 lens 504/0 e 0 to 0 dl 1788666241 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788666230.674650:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab2bfaafb80 with x1875552173624960 ext(0->12) 00010000:00010000:2.0:1788666230.674660:0:6656:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea395 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ac1 expref: 7 pid: 8429 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.674697:0:6656:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea395 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ac1 expref: 7 pid: 8429 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788666230.674706:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ab2bfaafb80 00000100:00100000:2.0:1788666230.674753:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:2.0:1788666230.674773:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173624960:12345-192.168.201.25@tcp:4:lfs.0 00000100:00100000:2.0:1788666230.675344:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0911d461-5865-4ef7-8c3e-012fc04add58+9:2363:x1875552173624960:12345-192.168.201.25@tcp:4:lfs.0 Request processed in 571us (992us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788666230.675353:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 2 00002000:00100000:2.0:1788666230.675360:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8ab2bfaafb80 x1875552173624960/t4294967305(0) o4->0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp:271/0 lens 504/448 e 0 to 0 dl 1788666241 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788666230.675369:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab2bfaafb80 with x1875552173624960 ext(0->12) 00010000:00010000:2.0:1788666230.675376:0:6656:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea395 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ac1 expref: 9 pid: 8429 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.675389:0:6656:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea395 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ac1 expref: 9 pid: 8429 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788666230.675397:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ab2bfaafb80 00000100:00100000:1.0:1788666230.675689:0:6651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae794380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6651:1875552186214656:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788666230.675723:0:6651:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000032da61c/0x96bbe788361ea3e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666230.678684:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666230.678840:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173625088 00000100:00100000:3.0:1788666230.678852:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173625088 00010000:00010000:3.0:1788666230.678905:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea395 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ac1 expref: 9 pid: 8429 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666230.678951:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 62 00000100:00100000:3.0:1788666230.678964:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+9:2361:x1875552173625088:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666230.678983:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788666230.679004:0:5793:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788666230.679007:0:5793:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788666230 00002000:00010000:3.0:1788666230.679010:0:5793:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788666231 00002000:00010000:3.0:1788666230.679012:0:5793:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788666230 00010000:00010000:3.0:1788666230.679019:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea395 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ac1 expref: 9 pid: 8429 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.679034:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea395 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ac1 expref: 9 pid: 8429 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.679061:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ba9ae9d/0x96bbe788361ea395 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ac1 expref: 9 pid: 8429 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.679079:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788666230.679164:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788666230.679171:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000032da61c/0x96bbe788361ea3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.679195:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000032da61c/0x96bbe788361ea3e2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.679220:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666230.679287:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+8:2361:x1875552173625088:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 327us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666230.679295:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 62 00010000:00010000:1.0:1788666230.679387:0:6651:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000032da61c/0x96bbe788361ea3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.679397:0:6651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000032da61c/0x96bbe788361ea3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.679425:0:6651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000032da61c/0x96bbe788361ea3e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.679433:0:6651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000032da61c/0x96bbe788361ea3e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.679452:0:6651:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000032da61c/0x96bbe788361ea3e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.679459:0:6651:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855e00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:1.0:1788666230.679463:0:6651:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000032da61c/0x96bbe788361ea3e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.679472:0:6651:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000032da61c/0x96bbe788361ea3e2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.679485:0:6651:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000032da61c/0x96bbe788361ea3e2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.679492:0:6651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000032da61c/0x96bbe788361ea3e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666230.679539:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+7:2362:x1875552173624832:12345-192.168.201.25@tcp:1:lfs.0 Request processed in 20331us (20512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666230.679547:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:0.0:1788666230.682524:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666230.682678:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173625344 00000100:00100000:1.0:1788666230.682691:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173625344 00000100:00100000:1.0:1788666230.682780:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:1.0:1788666230.682794:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28f367c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+24:11392:x1875552173625344:12345-192.168.201.25@tcp:35:lfs.0 00000004:00010000:1.0:1788666230.682887:0:5812:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea3d4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42add expref: 24 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788666230.683222:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1788666230.683266:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1788666230.683935:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1788666230.683998:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea3e9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.684018:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea380 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ab3 expref: 28 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.684028:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea3e9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.684067:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ab3 expref: 28 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.684082:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea380 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ab3 expref: 28 pid: 5808 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666230.684098:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae794380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5812:1875552186214784:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788666230.684202:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29a089900 going to sleep for 11 seconds 00000100:00100000:2.0:1788666230.694957:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666230.695198:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae794380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5812:1875552186214784:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788666230.695234:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea3e9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666230.697550:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173625472 00000100:00100000:0.0:1788666230.697566:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173625472 00010000:00010000:1.0:1788666230.702385:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea380 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ab3 expref: 29 pid: 5808 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666230.702575:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:1.0:1788666230.702608:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+29:2364:x1875552173625472:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666230.702632:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666230.702641:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea380 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ab3 expref: 29 pid: 5808 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.702656:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ab3 expref: 29 pid: 5808 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.702683:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea380 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ab3 expref: 29 pid: 5808 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.702706:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2a088e300) 00010000:00010000:1.0:1788666230.702713:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea3e9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.704309:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea3e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.704320:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea3e9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.704383:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666230.704494:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+28:2364:x1875552173625472:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 1886us (9545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666230.704509:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 63 00010000:00010000:0.0:1788666230.704839:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea3e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666230.704849:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea3e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788666230.705094:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788666230.705347:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1788666230.705500:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5812:1875552186214912:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788666230.705627:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666230.705686:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186214912 00000100:00100000:0.0:1788666230.705699:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186214912 00000100:00100000:0.0:1788666230.705794:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788666230.705805:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1875552186214912:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788666230.705899:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1875552186214912:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 96us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666230.705907:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788666230.705941:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab283891600 going to sleep for 11 seconds 00000100:00100000:0.0:1788666230.705978:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5812:1875552186214912:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788666230.706527:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788666230.706621:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab281324e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5812:1875552186215040:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788666230.706662:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666230.706697:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186215040 00000100:00100000:0.0:1788666230.706703:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186215040 00000100:00100000:0.0:1788666230.706737:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788666230.706744:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1875552186215040:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788666230.706920:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5812:x1875552186215040:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 176us (257us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788666230.706927:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788666230.706951:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2c1b6bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788666230.706973:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab281324e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5812:1875552186215040:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788666230.707026:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788666230.707059:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea3e9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666230.707069:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea3e9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666230.707077:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea3e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666230.707084:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298854e00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666230.707090:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea3e9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666230.707097:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea3e9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666230.707114:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2a088e300) 00010000:00010000:0.0:1788666230.707117:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788666230.707121:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea3e9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666230.707128:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea3e9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788666230.707310:0:5812:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788666230.707449:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1788666230.707462:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 337415881503ns, next at 338415878990ns, rc = 0 00000001:00080000:0.0:1788666230.707470:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788666230.707498:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2a088e300) 00010000:00010000:0.0:1788666230.707502:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788666230.707515:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea3d4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42add expref: 32 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666230.707662:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28f367c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+31:11392:x1875552173625344:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 24871us (25152us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788666230.707671:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 38 00000020:00080000:0.0:1788666230.707674:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:2.0:1788666230.708107:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788666230.724043:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666230.724262:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173625600 00000100:00100000:1.0:1788666230.724304:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173625600 00000100:00100000:1.0:1788666230.724384:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 148 00000100:00100000:1.0:1788666230.724395:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+31:11392:x1875552173625600:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788666230.724431:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666230.724457:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea3f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42ae4 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.724531:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea3f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ae4 expref: 32 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.724545:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea3f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ae4 expref: 32 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666230.724564:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:1.0:1788666230.724568:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788666230.724571:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855e00, rc 0) 00000100:00100000:1.0:1788666230.724664:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+32:11392:x1875552173625600:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 271us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666230.724671:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 148 00000100:00100000:0.0:1788666230.729863:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666230.729947:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173625856 00000100:00100000:1.0:1788666230.729959:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173625856 00000100:00100000:1.0:1788666230.730163:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:1.0:1788666230.730175:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+32:11392:x1875552173625856:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:1.0:1788666230.730514:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281325f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+33:11392:x1875552173625856:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 340us (800us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1788666230.730524:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 39 00010000:00010000:0.0:1788666230.794990:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666230.868125:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666230.871017:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173626112 00000100:00100000:2.0:1788666230.871038:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173626112 00000100:00100000:2.0:1788666230.871211:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 149 00000100:00100000:2.0:1788666230.871223:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+33:11402:x1875552173626112:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666230.871250:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666230.871274:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea3f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42aeb expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666230.871949:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788666230.872082:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea3f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42aeb expref: 35 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.872099:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab290a48300) 00010000:00010000:2.0:1788666230.872102:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788666230.872107:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea3f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42aeb expref: 35 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.872123:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2800, rc 0) 00000100:00100000:2.0:1788666230.872255:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+34:11402:x1875552173626112:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1033us (4143us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788666230.872264:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 149 00000100:00100000:2.0:1788666230.881010:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666230.881095:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173626240 00000100:00100000:3.0:1788666230.881109:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173626240 00000100:00100000:3.0:1788666230.881192:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 150 00000100:00100000:3.0:1788666230.881207:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+34:11402:x1875552173626240:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:3.0:1788666230.881337:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea405 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881359:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea405 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881371:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea405 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881388:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea40c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881396:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea40c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881404:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea40c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881525:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea413 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881535:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881542:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788666230.881621:0:7132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881635:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea405 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881643:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea405 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881650:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea405 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881656:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666230.881660:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea405 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881668:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea405 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881681:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:3.0:1788666230.881684:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666230.881690:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea405 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881704:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea405 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881722:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea40c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881727:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea40c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881732:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea40c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881737:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff000 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666230.881740:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea40c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881746:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea40c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881764:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab2b9e72b00) 00010000:00010000:3.0:1788666230.881767:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666230.881771:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea40c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881778:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea40c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881794:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea413 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881800:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea413 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881814:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881819:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ffc00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666230.881821:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea413 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881827:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea413 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881835:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:3.0:1788666230.881837:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666230.881840:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea413 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666230.881846:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea413 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666230.881931:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+34:11402:x1875552173626240:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 726us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666230.881939:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 150 00000100:00100000:0.0:1788666230.886085:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666230.887820:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173626496 00000100:00100000:2.0:1788666230.887839:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173626496 00000100:00100000:2.0:1788666230.892173:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:2.0:1788666230.892213:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+34:11402:x1875552173626496:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1788666230.892655:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+35:11402:x1875552173626496:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 465us (6583us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1788666230.892663:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:0.0:1788666230.966801:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666230.966912:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173626752 00000100:00100000:2.0:1788666230.966926:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173626752 00000100:00100000:2.0:1788666230.967010:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 151 00000100:00100000:2.0:1788666230.967022:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+35:11405:x1875552173626752:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666230.967055:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666230.967084:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea41a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42af2 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967203:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea421 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967223:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea421 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967239:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea421 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967265:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea428 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967273:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967280:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967419:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea42f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967426:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea42f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967455:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea42f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666230.967465:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788666230.967628:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea421 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967636:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea421 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967643:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea421 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967650:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666230.967656:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea421 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967664:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea421 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967677:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:2.0:1788666230.967681:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666230.967686:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea421 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967692:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea421 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967705:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea428 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967710:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea428 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967723:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967728:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2e00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666230.967731:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea428 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967737:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea428 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967744:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab2a088e100) 00010000:00010000:2.0:1788666230.967747:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666230.967750:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea428 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967767:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea428 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967816:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea41a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42af2 expref: 38 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967830:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea42f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42af2 expref: 37 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.967839:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:2.0:1788666230.967841:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666230.967844:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f3600, rc 0) 00000100:00100000:2.0:1788666230.967919:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+37:11405:x1875552173626752:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 899us (1128us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1788666230.967936:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 151 00000100:00100000:3.0:1788666230.973465:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666230.973698:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173626880 00000100:00100000:2.0:1788666230.973712:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173626880 00000100:00100000:2.0:1788666230.973795:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 152 00000100:00100000:2.0:1788666230.973807:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+37:11405:x1875552173626880:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:2.0:1788666230.973913:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea43d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.973936:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea43d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.973951:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea43d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.973982:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea43d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.973989:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea43d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.973999:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea43d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.974005:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666230.974011:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea43d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.974020:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea43d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.974032:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:2.0:1788666230.974052:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788666230.974058:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea43d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666230.974065:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea43d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666230.974158:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+37:11405:x1875552173626880:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 352us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666230.974166:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 152 00000100:00100000:0.0:1788666230.983706:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666230.983981:0:11980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173627136 00000100:00100000:3.0:1788666230.983993:0:11980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173627136 00000100:00100000:3.0:1788666230.984058:0:11980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 41 00000100:00100000:3.0:1788666230.984069:0:11980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+37:11405:x1875552173627136:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1788666230.984387:0:11980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+38:11405:x1875552173627136:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 319us (692us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788666230.984410:0:11980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 41 00000100:00100000:3.0:1788666231.182368:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788666231.186416:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186215296:0@lo:400:kworker.0 00000100:00100000:3.0:1788666231.186539:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666231.186731:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186215168:0@lo:400:kworker.0 00000100:00100000:3.0:1788666231.186781:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666231.192330:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186215168 00000100:00100000:0.0:1788666231.192348:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186215168 00000100:00100000:0.0:1788666231.192433:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788666231.192444:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186215168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666231.192573:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290465850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186215168:12345-0@lo:400:kworker.0 Request processed in 129us (5790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666231.192616:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788666231.192939:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186215424:0@lo:400:kworker.0 00000100:00100000:1.0:1788666231.192998:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666231.193087:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae794380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186215168:0@lo:400:kworker.0 00000100:00100000:3.0:1788666231.193119:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788666231.193130:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186215680:0@lo:400:kworker.0 00000100:00100000:0.0:1788666231.193457:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186215552:0@lo:400:kworker.0 00000100:00100000:0.0:1788666231.193488:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666231.193608:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186215552 00000100:00100000:3.0:1788666231.193614:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186215552 00000100:00080000:0.0:1788666231.193756:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788666231.193807:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788666231.193817:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186215552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666231.193868:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281326d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186215552:12345-0@lo:400:kworker.0 Request processed in 53us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666231.193874:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788666231.193947:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae364000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186215552:0@lo:400:kworker.0 00000100:00100000:0.0:1788666231.195458:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666231.195515:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186215296 00000100:00100000:2.0:1788666231.195524:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186215296 00000100:00100000:2.0:1788666231.195567:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186215424 00000100:00100000:2.0:1788666231.195570:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186215424 00000100:00100000:2.0:1788666231.195619:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788666231.195630:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186215296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666231.195789:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788666231.195800:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186215424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666231.195867:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae367480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186215424:12345-0@lo:400:kworker.0 Request processed in 70us (2869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666231.195874:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788666231.195917:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186215424:0@lo:400:kworker.0 00000100:00080000:1.0:1788666231.195957:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666231.196437:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186215296:12345-0@lo:400:kworker.0 Request processed in 808us (9897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666231.196445:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788666231.196597:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186215296:0@lo:400:kworker.0 00000100:00100000:1.0:1788666231.196678:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186215680 00000100:00100000:1.0:1788666231.196684:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186215680 00000100:00100000:1.0:1788666231.196739:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788666231.196747:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186215680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666231.196806:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281327800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186215680:12345-0@lo:400:kworker.0 Request processed in 61us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666231.196813:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:0.0:1788666231.197152:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666231.197188:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae364e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186215680:0@lo:400:kworker.0 00000100:00100000:0.0:1788666231.357282:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666231.364266:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173627392 00000100:00100000:1.0:1788666231.364286:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173627392 00000100:00100000:1.0:1788666231.364399:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 153 00000100:00100000:1.0:1788666231.364409:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+38:11437:x1875552173627392:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:1.0:1788666231.364437:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666231.364460:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea444 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42af9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666231.364571:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea44b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666231.364603:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea44b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666231.364637:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea44b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666231.364651:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788666231.364824:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea444 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42af9 expref: 41 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666231.364848:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea44b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42af9 expref: 40 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666231.364860:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:1.0:1788666231.364863:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788666231.364867:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855200, rc 0) 00000100:00080000:0.0:1788666231.365061:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788666231.366177:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281327100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+40:11437:x1875552173627392:12345-192.168.201.25@tcp:101:cat.0 Request processed in 1689us (8833us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788666231.366188:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 153 00000100:00100000:2.0:1788666231.384545:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666231.384709:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173627648 00000100:00100000:1.0:1788666231.384722:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173627648 00000100:00100000:1.0:1788666231.384806:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:1.0:1788666231.384817:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+40:11437:x1875552173627648:12345-192.168.201.25@tcp:35:cat.0 00000100:00100000:1.0:1788666231.385205:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+41:11437:x1875552173627648:12345-192.168.201.25@tcp:35:cat.0 Request processed in 388us (672us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788666231.385214:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:3.0:1788666231.395694:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666231.396327:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173627776 00000100:00100000:0.0:1788666231.396340:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173627776 00000100:00100000:0.0:1788666231.396439:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:0.0:1788666231.396451:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a096e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+41:2364:x1875552173627776:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788666231.396469:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666231.396494:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea44b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42af9 expref: 41 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666231.396516:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:0.0:1788666231.396522:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666231.396651:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a096e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+40:2364:x1875552173627776:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 202us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666231.396660:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:0.0:1788666231.508115:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666231.508278:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173628032 00000100:00100000:1.0:1788666231.508290:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173628032 00000100:00100000:1.0:1788666231.508363:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 154 00000100:00100000:1.0:1788666231.508385:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+40:11443:x1875552173628032:12345-192.168.201.25@tcp:101:dd.0 00010000:00010000:1.0:1788666231.508439:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666231.508443:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788666231.508479:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea3b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42acf expref: 40 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666231.508506:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:1.0:1788666231.508513:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788666231.508530:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea459 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b00 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666231.508716:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea460 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666231.508733:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea42f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42af2 expref: 40 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666231.508754:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea460 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666231.508797:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea42f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42af2 expref: 40 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666231.508815:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea42f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42af2 expref: 40 pid: 5808 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666231.508831:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae365f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5810:1875552186215808:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788666231.508975:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29a089000 going to sleep for 11 seconds 00000100:00100000:2.0:1788666231.518071:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666231.518172:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173628160 00000100:00100000:3.0:1788666231.518183:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173628160 00010000:00010000:3.0:1788666231.518238:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea42f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42af2 expref: 41 pid: 5808 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666231.518282:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:3.0:1788666231.518293:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+41:2363:x1875552173628160:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666231.518312:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666231.518338:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea42f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42af2 expref: 41 pid: 5808 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666231.518353:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea42f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42af2 expref: 41 pid: 5808 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666231.518384:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:3.0:1788666231.518390:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea460 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666231.518401:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea460 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666231.518410:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea460 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666231.518430:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666231.518493:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa74380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+41:2363:x1875552173628160:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 202us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666231.518500:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 64 00010000:00010000:1.0:1788666231.519890:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea42f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42af2 expref: 40 pid: 5808 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666231.519932:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae365f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5810:1875552186215808:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788666231.519958:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea460 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666231.519968:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea460 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666231.519974:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea460 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666231.519994:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788666231.520954:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea459 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b00 expref: 41 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666231.520976:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea460 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b00 expref: 40 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666231.520986:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:1.0:1788666231.520990:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788666231.520993:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855400, rc 0) 00000100:00100000:1.0:1788666231.521074:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+40:11443:x1875552173628032:12345-192.168.201.25@tcp:101:dd.0 Request processed in 12700us (12982us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788666231.521083:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 154 00000100:00100000:2.0:1788666231.526070:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666231.526271:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173628416 00000100:00100000:1.0:1788666231.526290:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173628416 00000100:00100000:1.0:1788666231.526390:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 155 00000100:00100000:1.0:1788666231.526409:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+40:11443:x1875552173628416:12345-192.168.201.25@tcp:36:dd.0 00010000:00010000:1.0:1788666231.527235:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea46e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666231.527259:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea46e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666231.527273:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea46e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788666231.527341:0:12001:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:1.0:1788666231.527373:0:12001:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000104d2564 reply state 00000000e3d4749a transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea46e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666231.527386:0:12001:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788666231.527533:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+43:11443:x1875552173628416:12345-192.168.201.25@tcp:36:dd.0 Request processed in 1127us (1478us total) trans 4294967441 rc 0/0 00000100:00100000:1.0:1788666231.527544:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 155 00000020:00080000:1.0:1788666231.527553:0:12001:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788666231.530086:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea46e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666231.530122:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea46e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666231.530132:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea46e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666231.530140:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666231.530146:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea46e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666231.530177:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea46e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666231.530199:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:3.0:1788666231.530203:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666231.530209:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea46e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666231.530217:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855800/0x96bbe788361ea46e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666231.691533:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788666231.691576:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab281324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186215936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788666231.691723:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666231.692231:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186215936 00000100:00100000:0.0:1788666231.692797:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186215936 00000100:00100000:0.0:1788666231.693064:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788666231.693079:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae365f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3275:x1875552186215936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788666231.693129:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666231.693776:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae365f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3275:x1875552186215936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666231.693787:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788666231.694276:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab281324700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186215936:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788666231.819191:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666231.891380:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666231.894365:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173628544 00000100:00100000:2.0:1788666231.894389:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173628544 00000100:00100000:2.0:1788666231.894563:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 156 00000100:00100000:2.0:1788666231.894577:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+42:11457:x1875552173628544:12345-192.168.201.25@tcp:101:stat.0 00010000:00010000:2.0:1788666231.894627:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666231.894671:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea475 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b07 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.894817:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea47c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.894834:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea47c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.894846:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea47c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.894862:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea483 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.894869:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.894875:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.894981:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea48a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.894993:0:7132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea460 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b00 expref: 43 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.895003:0:7132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea48a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.895044:0:7132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea460 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b00 expref: 43 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.895071:0:7132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea460 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b00 expref: 43 pid: 5810 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666231.895225:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea1df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186216064:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788666231.895367:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b7840 going to sleep for 11 seconds 00000100:00100000:3.0:1788666231.902322:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea1df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186216064:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788666231.902359:0:7132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea48a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666231.902422:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666231.905066:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173628800 00000100:00100000:1.0:1788666231.905161:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173628800 00000100:00100000:1.0:1788666231.905271:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:1.0:1788666231.905283:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+44:5600:x1875552173628800:12345-192.168.201.25@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788666231.905983:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+45:5600:x1875552173628800:12345-192.168.201.25@tcp:35:ldlm_bl.0 Request processed in 700us (3558us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1788666231.906010:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:0.0:1788666231.909311:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666231.909422:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173628928 00000100:00100000:3.0:1788666231.909435:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173628928 00010000:00010000:3.0:1788666231.909486:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea460 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b00 expref: 45 pid: 5810 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666231.909532:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 65 00000100:00100000:3.0:1788666231.909543:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281326a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+45:2364:x1875552173628928:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666231.909558:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666231.909565:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea460 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b00 expref: 45 pid: 5810 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666231.909795:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea460 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b00 expref: 45 pid: 5810 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666231.909822:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea460 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b00 expref: 45 pid: 5810 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666231.909842:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:3.0:1788666231.909849:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea48a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666231.909858:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea48a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666231.909867:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea48a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666231.909958:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666231.910034:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281326a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+44:2364:x1875552173628928:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 492us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666231.910044:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 65 00010000:00010000:2.0:1788666231.914330:0:7132:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea48a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.914356:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea48a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666231.914788:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788666231.914794:0:7132:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788666231.914823:0:7132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea48a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.914842:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea48a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.914856:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea47c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.914864:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea47c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.914873:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea47c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.914880:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2c00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666231.914926:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea47c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.914936:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea47c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.914958:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:2.0:1788666231.915860:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666231.915873:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea47c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.915883:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea47c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.915909:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea483 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.915916:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea483 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.915922:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.915927:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666231.915930:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea483 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.915937:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea483 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.915951:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab2a088e100) 00010000:00010000:2.0:1788666231.915953:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666231.916329:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea483 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.916335:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea483 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.916410:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea475 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b07 expref: 44 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.916428:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea48a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b07 expref: 43 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666231.916436:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:2.0:1788666231.916438:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666231.916441:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f3600, rc 0) 00000100:00100000:2.0:1788666231.916594:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+43:11457:x1875552173628544:12345-192.168.201.25@tcp:101:stat.0 Request processed in 22001us (25205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666231.916604:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 156 00000100:00100000:0.0:1788666231.993361:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666231.996250:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173629184 00000100:00100000:1.0:1788666231.996282:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173629184 00000100:00100000:1.0:1788666231.997524:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 157 00000100:00100000:1.0:1788666231.997559:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+43:11463:x1875552173629184:12345-192.168.201.25@tcp:36:truncate.0 00010000:00010000:1.0:1788666231.997841:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666231.997888:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea48a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b07 expref: 43 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666231.997921:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:1.0:1788666231.997929:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788666231.998196:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea491 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666231.998211:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666231.998223:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788666231.998278:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:1.0:1788666231.998311:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000be64fbd1 reply state 00000000b9d926b3 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666231.998323:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788666232.001301:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+45:11463:x1875552173629184:12345-192.168.201.25@tcp:36:truncate.0 Request processed in 3736us (7928us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1788666232.001323:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 157 00000020:00080000:1.0:1788666232.001359:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788666232.006211:0:3261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea491 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.006233:0:3261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea491 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.006242:0:3261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea491 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.006269:0:3261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298854e00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666232.006275:0:3261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea491 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.006285:0:3261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea491 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.006308:0:3261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:3.0:1788666232.006311:0:3261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666232.006316:0:3261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea491 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.006323:0:3261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea491 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666232.152169:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666232.152528:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173629312 00000100:00100000:2.0:1788666232.152544:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173629312 00000100:00100000:2.0:1788666232.152659:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 158 00000100:00100000:2.0:1788666232.152674:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+44:11476:x1875552173629312:12345-192.168.201.25@tcp:101:stat.0 00010000:00010000:2.0:1788666232.152724:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666232.152771:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea498 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b0e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.152875:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea49f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.152915:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea49f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.152930:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea49f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.152950:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea4a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.152958:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.152965:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.153102:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea4ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.153111:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea4ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.153119:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea4ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666232.153162:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1788666232.153167:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788666232.153195:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea4ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.153209:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea4ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.153233:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea49f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.153241:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea49f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.153250:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea49f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.153257:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2c00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666232.153325:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea49f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.153337:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea49f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.153353:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:2.0:1788666232.153356:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666232.153362:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea49f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.153369:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea49f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.153389:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea4a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.153396:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea4a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.153401:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.153413:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666232.153417:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea4a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.153423:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea4a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.153431:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab2a088e100) 00010000:00010000:2.0:1788666232.153434:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666232.153437:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea4a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.153443:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea4a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.153490:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea498 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b0e expref: 46 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.153505:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea4ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b0e expref: 45 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.153512:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:2.0:1788666232.153514:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666232.153517:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2a00, rc 0) 00000100:00100000:2.0:1788666232.153684:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+45:11476:x1875552173629312:12345-192.168.201.25@tcp:101:stat.0 Request processed in 1013us (1531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666232.153694:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 158 00000100:00100000:0.0:1788666232.241149:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666232.241254:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173629568 00000100:00100000:2.0:1788666232.241281:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173629568 00000100:00100000:2.0:1788666232.241421:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 159 00000100:00100000:2.0:1788666232.241433:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+45:11487:x1875552173629568:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666232.241459:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666232.241485:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea4b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b15 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666232.241616:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788666232.242826:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea4b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b15 expref: 47 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.242850:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab290a48300) 00010000:00010000:2.0:1788666232.242854:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788666232.242860:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea4b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b15 expref: 47 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.242884:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2600, rc 0) 00000100:00100000:2.0:1788666232.243438:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+46:11487:x1875552173629568:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 2004us (2355us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1788666232.243449:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 159 00000100:00100000:1.0:1788666232.253817:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666232.253997:0:11980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173629824 00000100:00100000:3.0:1788666232.254009:0:11980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173629824 00000100:00100000:3.0:1788666232.254386:0:11980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:3.0:1788666232.254405:0:11980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28f365c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+46:11487:x1875552173629824:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1788666232.254936:0:11980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28f365c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+47:11487:x1875552173629824:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 535us (1136us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788666232.257184:0:11980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:0.0:1788666232.319777:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666232.320078:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173630080 00000100:00100000:1.0:1788666232.320089:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173630080 00000100:00100000:1.0:1788666232.320195:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 160 00000100:00100000:1.0:1788666232.320206:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+47:11493:x1875552173630080:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788666232.320231:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666232.320252:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea4c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b1c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.320398:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea4c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.320414:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea4ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b0e expref: 48 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.320424:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea4c9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.320460:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea4ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b0e expref: 48 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.320474:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea4ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b0e expref: 48 pid: 5809 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666232.320488:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae366680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5810:1875552186216192:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788666232.320619:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab292342240 going to sleep for 11 seconds 00000100:00100000:1.0:1788666232.329324:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae366680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5810:1875552186216192:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788666232.329386:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea4c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666232.336255:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666232.340223:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173630208 00000100:00100000:1.0:1788666232.340258:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173630208 00010000:00010000:1.0:1788666232.340406:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea4ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b0e expref: 49 pid: 5809 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666232.340555:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 66 00000100:00100000:1.0:1788666232.341065:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281325f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+49:2364:x1875552173630208:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666232.341093:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666232.341102:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea4ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b0e expref: 49 pid: 5809 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.341119:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea4ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b0e expref: 49 pid: 5809 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.341153:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea4ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b0e expref: 49 pid: 5809 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.341176:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:1.0:1788666232.341182:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea4c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.341192:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea4c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.341201:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea4c9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.341260:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666232.341357:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281325f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+48:2364:x1875552173630208:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 300us (5118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666232.341367:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 66 00010000:00010000:2.0:1788666232.343464:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea4c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.343484:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea4c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666232.343513:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788666232.343820:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea4c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b1c expref: 49 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.343872:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea4c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b1c expref: 48 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.343882:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:2.0:1788666232.343885:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788666232.343889:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298854200, rc 0) 00000100:00100000:2.0:1788666232.344432:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+48:11493:x1875552173630080:12345-192.168.201.25@tcp:101:bash.0 Request processed in 24224us (24668us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788666232.344442:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 160 00000100:00100000:0.0:1788666232.350892:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666232.355165:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173630464 00000100:00100000:3.0:1788666232.355186:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173630464 00000100:00100000:2.0:1788666232.360684:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 161 00000100:00100000:2.0:1788666232.360706:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+48:11493:x1875552173630464:12345-192.168.201.25@tcp:36:bash.0 00010000:00010000:2.0:1788666232.361213:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea4d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.361235:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.361248:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788666232.361334:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1788666232.361362:0:5808:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008061ffeb reply state 00000000a59c33cc transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666232.361375:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788666232.361532:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+51:11493:x1875552173630464:12345-192.168.201.25@tcp:36:bash.0 Request processed in 831us (10657us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1788666232.361572:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 161 00000020:00080000:2.0:1788666232.361608:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788666232.363812:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea4d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.363840:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea4d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.363875:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea4d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.363882:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666232.363890:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea4d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.363899:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea4d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.363924:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:3.0:1788666232.363928:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666232.363934:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea4d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.363942:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea4d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666232.367899:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666232.368554:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173630592 00000100:00100000:2.0:1788666232.368576:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173630592 00000100:00100000:2.0:1788666232.369478:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 162 00000100:00100000:2.0:1788666232.369495:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+50:11493:x1875552173630592:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:2.0:1788666232.369536:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666232.369568:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea4de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b23 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.369966:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea4e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.369987:0:7132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea4c9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b1c expref: 51 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.369999:0:7132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea4e5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.370054:0:7132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea4c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b1c expref: 51 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.370075:0:7132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea4c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b1c expref: 51 pid: 5810 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666232.370094:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea1df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186216320:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788666232.370229:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788666232.375229:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea1df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186216320:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666232.375270:0:7132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea4e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666232.379024:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666232.379804:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173630720 00000100:00100000:1.0:1788666232.379821:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173630720 00010000:00010000:1.0:1788666232.379890:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea4c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b1c expref: 52 pid: 5810 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666232.380035:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 67 00000100:00100000:1.0:1788666232.380051:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281324700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+52:2363:x1875552173630720:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666232.380071:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666232.380215:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea4c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b1c expref: 52 pid: 5810 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.380235:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea4c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b1c expref: 52 pid: 5810 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.380266:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea4c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b1c expref: 52 pid: 5810 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.380285:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:1.0:1788666232.380291:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea4e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.380303:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.380353:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea4e5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.380413:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666232.380512:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281324700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+51:2363:x1875552173630720:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 464us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666232.380521:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 67 00010000:00010000:2.0:1788666232.380684:0:7132:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.380705:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666232.380778:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788666232.380784:0:7132:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788666232.380809:0:7132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.380847:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea4de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b23 expref: 51 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.380866:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea4e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b23 expref: 50 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.380874:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:2.0:1788666232.380876:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666232.380879:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2c00, rc 0) 00000100:00100000:2.0:1788666232.380908:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+50:11493:x1875552173630592:12345-192.168.201.25@tcp:101:bash.0 Request processed in 11421us (13032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666232.380917:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 162 00000100:00100000:0.0:1788666232.384516:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666232.384740:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173630976 00000100:00100000:1.0:1788666232.384752:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173630976 00000100:00100000:1.0:1788666232.384860:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:1.0:1788666232.384873:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+50:11493:x1875552173630976:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:1.0:1788666232.385455:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+51:11493:x1875552173630976:12345-192.168.201.25@tcp:35:bash.0 Request processed in 583us (952us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788666232.385465:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:0.0:1788666232.482774:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666232.482924:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173631232 00000100:00100000:2.0:1788666232.482938:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173631232 00000100:00100000:2.0:1788666232.483020:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 163 00000100:00100000:2.0:1788666232.483055:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+51:11503:x1875552173631232:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666232.483216:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666232.483309:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea4ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b2a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666232.483438:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788666232.491054:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea4ec lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b2a expref: 53 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666232.491231:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab290a48300) 00010000:00010000:0.0:1788666232.491235:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788666232.491243:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea4ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b2a expref: 53 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666232.491267:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f3800, rc 0) 00000100:00100000:0.0:1788666232.491397:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290507b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+52:11503:x1875552173631232:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 8341us (8636us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788666232.491411:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 163 00000100:00100000:0.0:1788666232.498994:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666232.499110:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173631360 00000100:00100000:3.0:1788666232.499122:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173631360 00000100:00100000:3.0:1788666232.499197:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 164 00000100:00100000:3.0:1788666232.499210:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+52:11503:x1875552173631360:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:3.0:1788666232.499350:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea4fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499377:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea4fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499395:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea4fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499437:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea501 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499447:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499454:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499643:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea508 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499653:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499659:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788666232.499716:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499741:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea4fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499748:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea4fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499755:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea4fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499761:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ffc00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666232.499765:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea4fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499781:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea4fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499797:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:3.0:1788666232.499802:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666232.499808:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea4fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499814:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea4fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499833:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea501 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499839:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea501 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499845:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499850:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff000 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666232.499852:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea501 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499857:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea501 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499862:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab2b9e72e00) 00010000:00010000:3.0:1788666232.499864:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666232.499867:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea501 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499882:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea501 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499898:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea508 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499904:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea508 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499909:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499914:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666232.499916:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea508 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499921:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea508 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499929:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:3.0:1788666232.499930:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666232.499933:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea508 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.499939:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea508 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666232.500050:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290507800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+52:11503:x1875552173631360:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 840us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666232.500059:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 164 00000100:00100000:1.0:1788666232.510264:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666232.512621:0:11980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173631616 00000100:00100000:3.0:1788666232.512638:0:11980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173631616 00000100:00100000:3.0:1788666232.512738:0:11980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:3.0:1788666232.512752:0:11980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+52:11503:x1875552173631616:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1788666232.513552:0:11980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+53:11503:x1875552173631616:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 801us (3484us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788666232.513560:0:11980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:0.0:1788666232.551755:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666232.551903:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173631872 00000100:00100000:2.0:1788666232.551916:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173631872 00000100:00100000:2.0:1788666232.551987:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 165 00000100:00100000:2.0:1788666232.551999:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+53:11506:x1875552173631872:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666232.552029:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666232.552056:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea50f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b31 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.552748:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea516 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.552771:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea516 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.552788:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea516 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.552812:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea51d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.552819:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea51d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.552826:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea51d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.552994:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea524 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.553003:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.553009:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666232.553018:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788666232.553204:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea516 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.553212:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea516 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.553230:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea516 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.553363:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666232.553369:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea516 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.553379:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea516 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.553395:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:2.0:1788666232.553399:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666232.553406:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea516 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.553424:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea516 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.553442:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea51d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.553448:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea51d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.553455:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea51d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.553460:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2e00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666232.553464:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea51d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.553469:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea51d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.553477:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab2a088e100) 00010000:00010000:2.0:1788666232.553480:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666232.553483:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea51d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.553489:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea51d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.553544:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea50f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b31 expref: 56 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.553559:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b31 expref: 55 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.553573:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:2.0:1788666232.553576:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666232.553741:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f3e00, rc 0) 00000100:00100000:2.0:1788666232.553863:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290505180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+55:11506:x1875552173631872:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1864us (2122us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1788666232.553873:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 165 00000100:00100000:0.0:1788666232.560328:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666232.560386:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666232.560495:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173632000 00000100:00100000:1.0:1788666232.560510:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173632000 00000100:00100000:1.0:1788666232.560610:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 166 00000100:00100000:1.0:1788666232.560619:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+55:11506:x1875552173632000:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:1.0:1788666232.560703:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea532 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.560724:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.560752:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.560823:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea532 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.560830:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea532 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.560838:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea532 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.560844:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855c00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666232.560849:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea532 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.560857:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea532 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.560869:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:1.0:1788666232.560873:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788666232.560877:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea532 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.560884:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea532 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666232.560957:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173632128 00000100:00100000:2.0:1788666232.560962:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173632128 00000100:00100000:1.0:1788666232.560971:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+56:11506:x1875552173632000:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 352us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666232.560979:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 166 00000100:00100000:2.0:1788666232.561000:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:2.0:1788666232.561007:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+55:2363:x1875552173632128:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788666232.561020:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666232.561038:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea524 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b31 expref: 55 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.561051:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:2.0:1788666232.561055:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666232.561088:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+54:2363:x1875552173632128:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 81us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666232.561095:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:1.0:1788666232.566712:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666232.566829:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173632384 00000100:00100000:0.0:1788666232.566845:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173632384 00000100:00100000:0.0:1788666232.566975:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:0.0:1788666232.567007:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+54:11506:x1875552173632384:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:0.0:1788666232.567315:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+55:11506:x1875552173632384:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 310us (617us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1788666232.567323:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:2.0:1788666232.716845:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788666232.725238:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186216448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788666232.725366:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666232.725848:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186216448 00000100:00100000:0.0:1788666232.725865:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186216448 00000100:00100000:0.0:1788666232.726150:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788666232.726164:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186216448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788666232.726215:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666232.726293:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186216448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666232.726374:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186216448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788666232.726563:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788666232.731561:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666232.731733:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173632640 00000100:00100000:1.0:1788666232.731747:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173632640 00000100:00100000:1.0:1788666232.731873:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 167 00000100:00100000:1.0:1788666232.731888:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+55:11524:x1875552173632640:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:1.0:1788666232.731931:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666232.731963:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea539 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b38 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.732089:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854a00/0x96bbe788361ea540 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.732108:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854a00/0x96bbe788361ea540 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.732125:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854a00/0x96bbe788361ea540 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666232.732137:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788666232.732274:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea539 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b38 expref: 58 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.732289:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854a00/0x96bbe788361ea540 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b38 expref: 57 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.732296:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:1.0:1788666232.732299:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788666232.732302:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298854a00, rc 0) 00000100:00100000:1.0:1788666232.732371:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+57:11524:x1875552173632640:12345-192.168.201.25@tcp:101:cat.0 Request processed in 490us (827us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788666232.732376:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 167 00000100:00100000:3.0:1788666232.790690:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666232.791833:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173632768 00000100:00100000:2.0:1788666232.791877:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173632768 00000100:00100000:2.0:1788666232.791993:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 168 00000100:00100000:2.0:1788666232.792006:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+57:11525:x1875552173632768:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666232.792040:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666232.792200:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea54e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b3f expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.792324:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea555 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.792340:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.792354:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666232.792496:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788666232.792502:0:7132:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788666232.792529:0:7132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea555 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.792563:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea54e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b3f expref: 59 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.792635:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea555 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b3f expref: 58 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666232.792644:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:2.0:1788666232.792647:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788666232.792651:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2e00, rc 0) 00000100:00100000:2.0:1788666232.792779:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+58:11525:x1875552173632768:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 774us (2102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666232.792788:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 168 00000100:00100000:2.0:1788666232.802194:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666232.802263:0:11980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173633152 00000100:00100000:3.0:1788666232.802282:0:11980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173633152 00000100:00100000:3.0:1788666232.802366:0:11980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:3.0:1788666232.802509:0:11980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+58:11525:x1875552173633152:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1788666232.803954:0:11980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+59:11525:x1875552173633152:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 1560us (1755us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788666232.803968:0:11980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:3.0:1788666232.811257:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666232.811326:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173633280 00000100:00100000:1.0:1788666232.811360:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173633280 00000100:00100000:1.0:1788666232.811718:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:1.0:1788666232.811775:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+59:11525:x1875552173633280:12345-192.168.201.25@tcp:103:lfs.0 00010000:00010000:1.0:1788666232.811802:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788666232.811836:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea4e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b23 expref: 59 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.811865:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854a00/0x96bbe788361ea540 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b38 expref: 58 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.811879:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea3f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ae4 expref: 57 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666232.811890:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:1.0:1788666232.811907:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666232.811985:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa74000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+56:11525:x1875552173633280:12345-192.168.201.25@tcp:103:lfs.0 Request processed in 216us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666232.811993:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:0.0:1788666232.815967:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666232.816271:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173633408 00000100:00100000:3.0:1788666232.816290:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173633408 00000100:00100000:3.0:1788666232.816394:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 169 00000100:00100000:3.0:1788666232.816411:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+56:11525:x1875552173633408:12345-192.168.201.25@tcp:58:lfs.0 00010000:00010000:3.0:1788666232.817107:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea55c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.817129:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea55c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.817155:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea55c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788666232.817441:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788666232.818366:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+56:11525:x1875552173633408:12345-192.168.201.25@tcp:58:lfs.0 Request processed in 1949us (2401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666232.818392:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 169 00010000:00010000:1.0:1788666232.842765:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666232.843376:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666232.843502:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173633536 00000100:00100000:3.0:1788666232.843514:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173633536 00000100:00100000:3.0:1788666232.843632:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 170 00000100:00100000:3.0:1788666232.843641:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+56:11527:x1875552173633536:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1788666232.843667:0:12001:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666232.843692:0:12001:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea563 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b46 expref: -99 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.843784:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea56a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.843802:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea56a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.843810:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea56a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.843822:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea571 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.843826:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.843847:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.843928:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea578 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.843933:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.843937:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666232.843967:0:12001:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788666232.843969:0:12001:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788666232.843985:0:12001:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.843993:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.843999:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea56a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.844003:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea56a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.844007:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea56a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.844011:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ffc00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666232.844014:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea56a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.844024:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea56a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.844033:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:3.0:1788666232.844035:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666232.844038:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea56a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.844042:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea56a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.844053:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea571 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.844056:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea571 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.844073:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea571 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.844076:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666232.844078:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea571 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.844081:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea571 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.844085:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab2b9e72500) 00010000:00010000:3.0:1788666232.844086:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666232.844088:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea571 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.844098:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea571 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.844122:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea563 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b46 expref: 58 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.844131:0:12001:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea578 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b46 expref: 57 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666232.844136:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2b9e72b00) 00010000:00010000:3.0:1788666232.844137:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788666232.844139:0:12001:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2814fe400, rc 0) 00000100:00100000:3.0:1788666232.844202:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+57:11527:x1875552173633536:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 562us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666232.844209:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 170 00000040:00080000:3.0:1788666233.425201:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788666233.425216:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788666233.425257:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788666233.425265:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788666233.428887:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab18253fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875552186216576:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788666233.429056:0:11650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2ae21bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788666233.445143:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666233.445247:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173633664 00000100:00100000:0.0:1788666233.445260:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173633664 00000100:00100000:0.0:1788666233.445359:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 171 00000100:00100000:0.0:1788666233.445373:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+58:11538:x1875552173633664:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788666233.445421:0:5810:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788666233.445623:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae366300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+58:11538:x1875552173633664:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 252us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666233.445632:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 171 00000100:00080000:1.0:1788666233.445884:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666233.445998:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab18253fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875552186216576:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788666233.460445:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666233.460489:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173633792 00000100:00100000:3.0:1788666233.460501:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173633792 00000100:00100000:3.0:1788666233.460568:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 172 00000100:00100000:3.0:1788666233.460635:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+57:11538:x1875552173633792:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788666233.460736:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea57f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.460756:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea57f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.460772:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea57f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.460837:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea586 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.460846:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea586 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.460853:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea586 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.460895:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea58d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.460905:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea58d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.460911:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea58d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666233.460960:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788666233.460966:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788666233.460984:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea58d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.461008:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea57f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.461015:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea57f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.461025:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea57f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.461031:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff000 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666233.461037:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea57f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.461046:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea57f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.461066:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab2908f2b00) 00010000:00010000:3.0:1788666233.461070:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666233.461077:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea57f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.461085:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff000/0x96bbe788361ea57f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.461105:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea586 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.461112:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea586 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.461119:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea586 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.461131:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666233.461134:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea586 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.461141:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea586 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.461149:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8ab2b9e72500) 00010000:00010000:3.0:1788666233.461152:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666233.461155:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea586 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.461161:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff400/0x96bbe788361ea586 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.461177:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea58d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.461183:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea58d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.461189:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea58d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.461193:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ffc00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666233.461196:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea58d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.461201:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea58d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.461218:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2b9e72b00) 00010000:00010000:3.0:1788666233.461220:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666233.461223:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea58d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.461229:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ffc00/0x96bbe788361ea58d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666233.461317:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+57:11538:x1875552173633792:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 Request processed in 684us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666233.461326:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 172 00000100:00100000:3.0:1788666233.469501:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666233.469562:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173634048 00000100:00100000:3.0:1788666233.469575:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173634048 00000100:00100000:3.0:1788666233.469672:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 173 00000100:00100000:3.0:1788666233.469685:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+57:11538:x1875552173634048:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788666233.469733:0:12001:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666233.469799:0:12001:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea594 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b4d expref: -99 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.469962:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea59b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.469981:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea59b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.469995:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea59b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666233.470020:0:12001:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788666233.470154:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea59b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.470163:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea59b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.470170:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea59b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.470176:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e9400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666233.470180:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea59b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.470187:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea59b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.470203:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2b9e72b00) 00010000:00010000:3.0:1788666233.470206:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788666233.470211:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea59b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.470217:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea59b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.470268:0:12001:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea594 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b4d expref: 59 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.470279:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab2908f2b00) 00010000:00010000:3.0:1788666233.470281:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788666233.470292:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea594 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b4d expref: 59 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.470304:0:12001:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e9800, rc 0) 00000100:00100000:3.0:1788666233.470381:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+58:11538:x1875552173634048:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 700us (898us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1788666233.470390:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 173 00000100:00100000:2.0:1788666233.473988:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666233.476345:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173634176 00000100:00100000:1.0:1788666233.476371:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173634176 00000100:00100000:1.0:1788666233.476494:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 174 00000100:00100000:1.0:1788666233.476506:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+58:11538:x1875552173634176:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788666233.476556:0:5809:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788666233.477040:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+58:11538:x1875552173634176:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 534us (3064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666233.477133:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 174 00000100:00100000:2.0:1788666233.482388:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666233.482953:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173634432 00000100:00100000:3.0:1788666233.482969:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173634432 00000100:00100000:3.0:1788666233.483037:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 175 00000100:00100000:3.0:1788666233.483049:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+58:11538:x1875552173634432:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788666233.483084:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666233.483088:0:7132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788666233.483120:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea555 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b3f expref: 58 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.483141:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:3.0:1788666233.483148:0:7132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788666233.483167:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea5a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b54 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788666233.484015:0:7132:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788666233.484280:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8000/0x96bbe788361ea5b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.484299:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8000/0x96bbe788361ea5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.484314:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8000/0x96bbe788361ea5b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.484413:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea5a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b54 expref: 60 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.484438:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8000/0x96bbe788361ea5b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b54 expref: 59 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.484447:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab2b9e72700) 00010000:00010000:3.0:1788666233.484450:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788666233.484453:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e8000, rc 0) 00000100:00100000:3.0:1788666233.485879:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+59:11538:x1875552173634432:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 2816us (3493us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788666233.485895:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 175 00000100:00100000:2.0:1788666233.500925:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666233.500988:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173634688 00000100:00100000:3.0:1788666233.501001:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173634688 00000100:00100000:3.0:1788666233.501074:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 176 00000100:00100000:3.0:1788666233.501084:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+59:11538:x1875552173634688:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788666233.501154:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666233.501184:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8000/0x96bbe788361ea5b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b54 expref: 59 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.501210:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab2b9e72700) 00010000:00010000:3.0:1788666233.501222:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788666233.501249:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea5be lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.501265:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea5be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.501292:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea5be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.501353:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe4c59a3f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.501362:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe4c59a3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.501368:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe4c59a3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.501436:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea5be lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.501444:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea5be lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.501451:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea5be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.501457:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e9200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666233.501462:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea5be lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.501470:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea5be lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.501478:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:3.0:1788666233.501481:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666233.501485:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea5be lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.501496:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea5be lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.501506:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe4c59a3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.501512:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5c5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe4c59a3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.501517:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe4c59a3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.501522:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e9800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666233.501525:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe4c59a3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.501531:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5c5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe4c59a3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.501538:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe4c59a3f (ffff8ab2b9e72500) 00010000:00010000:3.0:1788666233.501540:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666233.501543:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5c5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe4c59a3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.501561:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe4c59a3f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666233.501977:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+58:11538:x1875552173634688:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 890us (1062us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788666233.501986:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 176 00000100:00100000:2.0:1788666233.504856:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666233.504909:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173634816 00000100:00100000:1.0:1788666233.504923:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173634816 00000100:00100000:1.0:1788666233.505001:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 177 00000100:00100000:1.0:1788666233.505015:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29057b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+58:11538:x1875552173634816:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788666233.505050:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666233.505243:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea5cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b5b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.505288:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea5d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.505306:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.505319:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea5d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.505463:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea5cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b5b expref: 60 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.505485:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea5d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b5b expref: 59 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.505495:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:1.0:1788666233.505498:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788666233.505502:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855c00, rc 0) 00000100:00100000:1.0:1788666233.506180:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29057b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+59:11538:x1875552173634816:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 1162us (1330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666233.506201:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 177 00000100:00100000:0.0:1788666233.510987:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666233.511111:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173635072 00000100:00100000:3.0:1788666233.511121:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173635072 00000100:00100000:3.0:1788666233.511187:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 178 00000100:00100000:3.0:1788666233.511197:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+59:11538:x1875552173635072:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788666233.511292:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5da lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.511311:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.511325:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788666233.512151:0:7132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1788666233.512168:0:7132:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 340220587516ns, next at 341220583059ns, rc = 0 00000004:00010000:3.0:1788666233.512274:0:7132:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000debf7a1 reply state 0000000047b29370 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666233.512287:0:7132:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788666233.512461:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+61:11538:x1875552173635072:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 1258us (1479us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788666233.512471:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 178 00000100:00100000:0.0:1788666233.520016:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666233.520145:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173635200 00000100:00100000:1.0:1788666233.520161:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173635200 00000100:00100000:1.0:1788666233.520241:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 179 00000100:00100000:1.0:1788666233.520252:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+61:11538:x1875552173635200:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788666233.520294:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666233.520324:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea5e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b62 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.520419:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea5e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b62 expref: 62 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.520437:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea5e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b62 expref: 62 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.520463:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:1.0:1788666233.520467:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788666233.520473:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855e00, rc 0) 00000100:00100000:1.0:1788666233.520619:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+62:11538:x1875552173635200:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 369us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666233.520626:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 179 00010000:00010000:3.0:1788666233.523930:0:3261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5da lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.523958:0:3261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5da lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.523969:0:3261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.524000:0:3261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e9800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666233.524006:0:3261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5da lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.524013:0:3261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5da lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.524035:0:3261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:3.0:1788666233.524039:0:3261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788666233.524045:0:3261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5da lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.524051:0:3261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5da lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666233.524162:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666233.524328:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173635328 00000100:00100000:3.0:1788666233.524343:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173635328 00000100:00100000:3.0:1788666233.524435:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:3.0:1788666233.524448:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290579c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173635328:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788666233.525152:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788666233.525570:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290579c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+7:2364:x1875552173635328:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 1118us (1407us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788666233.525617:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:0.0:1788666233.530883:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666233.532410:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173635584 00000100:00100000:1.0:1788666233.532431:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173635584 00000100:00100000:1.0:1788666233.532598:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:1.0:1788666233.532621:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+61:11538:x1875552173635584:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788666233.532993:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+62:11538:x1875552173635584:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 375us (2124us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788666233.533002:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:0.0:1788666233.536107:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666233.536246:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173635840 00000100:00100000:3.0:1788666233.536259:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173635840 00000100:00100000:3.0:1788666233.536326:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 180 00000100:00100000:3.0:1788666233.536340:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+62:11538:x1875552173635840:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788666233.536502:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+62:11538:x1875552173635840:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 164us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666233.536521:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 180 00000100:00100000:0.0:1788666233.540307:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666233.540474:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173635968 00000100:00100000:3.0:1788666233.540485:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173635968 00000100:00100000:3.0:1788666233.540556:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 181 00000100:00100000:3.0:1788666233.540566:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+62:11538:x1875552173635968:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788666233.540778:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666233.540805:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b69 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.540919:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea5ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.540937:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea5ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.540949:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea5ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666233.540997:0:7132:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788666233.541021:0:7132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea5ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.541054:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea5e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b69 expref: 64 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.541083:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea5ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b69 expref: 63 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.541093:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:3.0:1788666233.541103:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788666233.541108:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e9200, rc 0) 00000100:00100000:3.0:1788666233.541221:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+63:11538:x1875552173635968:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 656us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666233.541229:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 181 00000100:00100000:0.0:1788666233.549196:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666233.549294:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173636096 00000100:00100000:3.0:1788666233.549309:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173636096 00000100:00100000:3.0:1788666233.549413:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:3.0:1788666233.549427:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173636096:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788666233.549458:0:6650:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666233.549492:0:6650:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361ea5f6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b70 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788666233.549533:0:6650:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ce179, blocks: 0x1 00010000:00010000:3.0:1788666233.549622:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=340s v=(0 0) 00010000:00010000:3.0:1788666233.549628:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666233.549640:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361ea5f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b70 expref: 8 pid: 6650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.549666:0:6650:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361ea5f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b70 expref: 8 pid: 6650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.549683:0:6650:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e8000, rc 0) 00000100:00100000:3.0:1788666233.549776:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+8:2363:x1875552173636096:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 353us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666233.549785:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:0.0:1788666233.553478:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666233.553842:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173636352 00000100:00100000:3.0:1788666233.553856:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173636352 00000100:00100000:3.0:1788666233.553961:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 182 00000100:00100000:3.0:1788666233.553972:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+63:11538:x1875552173636352:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788666233.554112:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+63:11538:x1875552173636352:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 141us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666233.554120:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 182 00000100:00100000:1.0:1788666233.557511:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666233.557748:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173636480 00000100:00100000:0.0:1788666233.557764:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173636480 00000100:00100000:0.0:1788666233.557839:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 53 00000100:00100000:0.0:1788666233.557851:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+8:11538:x1875552173636480:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788666233.557873:0:6651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666233.557895:0:6651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8e90843/0x96bbe788361ea5fd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b77 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666233.557934:0:6651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361ea5f6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b70 expref: 9 pid: 6650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666233.557942:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788666233.557948:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788666233.557954:0:6651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8e90843/0x96bbe788361ea5fd lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b77 expref: 9 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666233.558000:0:6651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361ea5f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b70 expref: 9 pid: 6650 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666233.558016:0:6651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361ea5f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b70 expref: 9 pid: 6650 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666233.558035:0:6651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6651:1875552186216704:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788666233.558296:0:6651:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2c1b6b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788666233.566651:0:6651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6651:1875552186216704:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788666233.566651:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666233.566697:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173636608 00000100:00100000:2.0:1788666233.566706:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173636608 00010000:00010000:3.0:1788666233.566721:0:6651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c8e90843/0x96bbe788361ea5fd lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b77 expref: 9 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.566748:0:6651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144a800, rc 0) 00010000:00010000:2.0:1788666233.566813:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361ea5f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b70 expref: 10 pid: 6650 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666233.566823:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+10:11538:x1875552173636480:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 8975us (9329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666233.566832:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 53 00000100:00100000:2.0:1788666233.566849:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:2.0:1788666233.566859:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a096e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+9:2364:x1875552173636608:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788666233.566880:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666233.566911:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361ea5f6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b70 expref: 9 pid: 6650 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666233.566926:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361ea5f6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b70 expref: 9 pid: 6650 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666233.566958:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361ea5f6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b70 expref: 9 pid: 6650 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666233.566989:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666233.566994:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666233.567004:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8e90843/0x96bbe788361ea5fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b77 expref: 8 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666233.567017:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8e90843/0x96bbe788361ea5fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b77 expref: 8 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666233.567081:0:5794:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c8e90843/0x96bbe788361ea5fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b77 expref: 8 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666233.567099:0:5794:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4568000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5794:1875552186216832:192.168.201.25@tcp:105: 00000100:00100000:2.0:1788666233.567162:0:5794:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788666233.571692:0:5794:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4568000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5794:1875552186216832:192.168.201.25@tcp:105: 00010000:00010000:0.0:1788666233.571745:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666233.571849:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a096e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+8:2364:x1875552173636608:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 4988us (5198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666233.571865:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:1.0:1788666233.579458:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666233.579695:0:6654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173636736 00000100:00100000:2.0:1788666233.579723:0:6654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173636736 00002000:00100000:2.0:1788666233.579803:0:6654:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8ab2ae366d80 x1875552173636736/t0(0) o4->0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp:274/0 lens 504/0 e 0 to 0 dl 1788666244 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788666233.579816:0:6654:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab2ae366d80 with x1875552173636736 ext(0->8) 00002000:00010000:2.0:1788666233.579826:0:6654:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab2ae366d80 00000100:00100000:2.0:1788666233.579869:0:6654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:2.0:1788666233.579883:0:6654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0911d461-5865-4ef7-8c3e-012fc04add58+8:2364:x1875552173636736:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788666233.581789:0:6654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae366d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0911d461-5865-4ef7-8c3e-012fc04add58+10:2364:x1875552173636736:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 Request processed in 1890us (2324us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788666233.581818:0:6654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00002000:00100000:2.0:1788666233.581834:0:6654:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8ab2ae366d80 x1875552173636736/t4294967314(0) o4->0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp:274/0 lens 504/448 e 0 to 0 dl 1788666244 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788666233.581845:0:6654:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab2ae366d80 with x1875552173636736 ext(0->8) 00002000:00010000:2.0:1788666233.581854:0:6654:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab2ae366d80 00000100:00100000:3.0:1788666233.585250:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666233.589421:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173636864 00000100:00100000:0.0:1788666233.589443:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173636864 00000100:00100000:0.0:1788666233.589950:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 183 00000100:00100000:0.0:1788666233.589964:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+63:11538:x1875552173636864:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788666233.653256:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+63:11538:x1875552173636864:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 Request processed in 63283us (68009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666233.653271:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 183 00000001:00080000:3.0:1788666233.653312:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000004:00080000:3.0:1788666233.653323:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788666233.653345:0:5830:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab2a0baab40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788666233.653350:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab290cf9c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab2a0baaf00 00000020:00080000:3.0:1788666233.653353:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab290cf9200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab290488c00 00000001:00080000:3.0:1788666233.653378:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1788666233.653458:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000100:00100000:3.0:1788666233.653766:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788666233.653783:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab18253f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186216960:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788666233.653839:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666233.653905:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186216960 00000100:00100000:3.0:1788666233.653913:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186216960 00000100:00100000:3.0:1788666233.653968:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788666233.653976:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186216960:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788666233.654207:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788666233.654211:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788666233 00002000:00010000:3.0:1788666233.654214:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788666233.654216:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788666233 -> 1788666233 00002000:00010000:3.0:1788666233.654219:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788666233.654254:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3277:x1875552186216960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 279us (414us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788666233.654261:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788666233.654281:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788666233.654312:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab18253f100/2, rc 0, transno 4294967315 00000100:00100000:3.0:1788666233.654318:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab18253f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186216960:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788666233.654497:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186217088:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788666233.654524:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788666233.655183:0:5841:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788666233.655624:0:5841:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788666233.658207:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666233.659931:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186217088 00000100:00100000:1.0:1788666233.659950:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186217088 00000100:00100000:0.0:1788666233.660000:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173636992 00000100:00100000:0.0:1788666233.660007:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173636992 00000100:00100000:1.0:1788666233.660053:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788666233.660075:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3275:x1875552186217088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788666233.660108:0:6651:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:1.0:1788666233.660142:0:6651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9ce176, atime: 0x6a9ce177, ctime: 0x6a9ce176, blocks: 0x1 00010000:00010000:1.0:1788666233.660152:0:6651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000346f3756/0x96bbe788361ea604 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.660167:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=340s v=(0 0) 00010000:00010000:1.0:1788666233.660172:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666233.660179:0:6651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000346f3756/0x96bbe788361ea604 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.660197:0:6651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000346f3756/0x96bbe788361ea604 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.660207:0:6651:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000346f3756/0x96bbe788361ea604 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.660215:0:6651:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000346f3756/0x96bbe788361ea604 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.660247:0:6651:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788666233.660838:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3275:x1875552186217088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 763us (6311us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788666233.660849:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:0.0:1788666233.661063:0:7594:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666233.661073:0:7594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000346f3756/0x96bbe788361ea604 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666233.661086:0:7594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298854e00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:0.0:1788666233.661091:0:7594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000346f3756/0x96bbe788361ea604 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666233.661102:0:7594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000346f3756/0x96bbe788361ea604 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666233.661122:0:7594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000346f3756/0x96bbe788361ea604 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666233.661131:0:7594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000346f3756/0x96bbe788361ea604 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666233.661222:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666233.661224:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666233.661226:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788666233.661869:0:3275:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab2bf9fc000/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788666233.661881:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186217088:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1788666233.662183:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788666233.663241:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:3.0:1788666233.663262:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+10:2364:x1875552173636992:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 00000040:00080000:2.0:1788666233.730340:0:12428:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788666233.730355:0:12428:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788666233.730405:0:12428:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788666233.730413:0:12428:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788666233.787176:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+10:2364:x1875552173636992:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 Request processed in 123902us (128965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666233.787202:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 56 00000001:00080000:0.0:1788666233.788182:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:0.0:1788666233.788204:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:2.0:1788666233.796012:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666233.796136:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173637248 00000100:00100000:3.0:1788666233.796148:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173637248 00000100:00100000:3.0:1788666233.796220:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 184 00000100:00100000:3.0:1788666233.796231:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+18:11538:x1875552173637248:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788666233.796305:0:7132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666233.796343:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea5ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b69 expref: 18 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.796365:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:3.0:1788666233.796371:0:7132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788666233.796405:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea60b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.796418:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea60b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.796428:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea60b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788666233.797063:0:7132:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f13d1ba2 reply state 00000000563e2982 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea60b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666233.797075:0:7132:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788666233.797186:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4568e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+19:11538:x1875552173637248:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 956us (1182us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1788666233.797194:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 184 00010000:00010000:3.0:1788666233.800169:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea60b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.800203:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea60b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.800213:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea60b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.800221:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e9800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666233.800228:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea60b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.800238:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea60b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.800261:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:3.0:1788666233.800265:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666233.800273:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea60b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.800281:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea60b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666233.803955:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666233.804040:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173637376 00000100:00100000:3.0:1788666233.804050:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173637376 00000100:00100000:3.0:1788666233.804096:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:3.0:1788666233.804106:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173637376:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788666233.804422:0:6651:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788666233.804427:0:6651:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788666233 -> 1788666232 00002000:00010000:3.0:1788666233.804430:0:6651:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788666231 00002000:00010000:3.0:1788666233.804433:0:6651:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788666233 -> 1788666232 00002000:00010000:3.0:1788666233.804450:0:6651:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788666233.804556:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae367800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+8:2363:x1875552173637376:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 450us (614us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788666233.804566:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:0.0:1788666233.825472:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666233.825595:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173637632 00000100:00100000:3.0:1788666233.825608:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173637632 00000100:00100000:3.0:1788666233.825672:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 185 00000100:00100000:3.0:1788666233.825684:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+18:11538:x1875552173637632:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788666233.825814:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea612 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.825836:0:12001:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea5d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b5b expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.825848:0:12001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea612 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.825900:0:12001:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea5d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b5b expref: 18 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.825921:0:12001:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea5d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b5b expref: 18 pid: 5809 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666233.825942:0:12001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae278e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12001:1875552186217216:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788666233.826057:0:12001:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2ae21b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788666233.830813:0:12001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae278e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12001:1875552186217216:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788666233.830853:0:12001:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea612 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666233.832328:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666233.832450:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173637760 00000100:00100000:1.0:1788666233.832461:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173637760 00010000:00010000:1.0:1788666233.832511:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea5d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b5b expref: 19 pid: 5809 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666233.832568:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:1.0:1788666233.832600:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae278e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+19:2363:x1875552173637760:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666233.832617:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666233.832625:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea5d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b5b expref: 19 pid: 5809 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.832640:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea5d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b5b expref: 19 pid: 5809 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.832664:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea5d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b5b expref: 19 pid: 5809 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.832682:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:1.0:1788666233.832689:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea612 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.832731:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea612 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.832741:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea612 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.832776:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666233.832847:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae278e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+18:2363:x1875552173637760:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 268us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666233.832857:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 69 00010000:00010000:2.0:1788666233.832875:0:12001:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea612 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666233.832885:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea612 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666233.832929:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea612 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666233.832937:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea612 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666233.832944:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea612 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666233.832952:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e9800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666233.832958:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea612 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666233.832975:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea612 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666233.832986:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:2.0:1788666233.832989:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788666233.832992:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea612 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666233.832998:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361ea612 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666233.833063:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+17:11538:x1875552173637632:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 Request processed in 7380us (7607us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788666233.833072:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 185 00000100:00100000:0.0:1788666233.842836:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666233.846943:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173637888 00000100:00100000:3.0:1788666233.846965:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173637888 00000100:00100000:2.0:1788666233.847873:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 58 00000100:00100000:2.0:1788666233.847890:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+8:2363:x1875552173637888:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788666233.847946:0:6650:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008cd6047d/0x96bbe788361ea619 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666233.847973:0:6650:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8e90843/0x96bbe788361ea5fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b77 expref: 8 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666233.847982:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666233.847987:0:6650:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788666233.847993:0:6650:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cd6047d/0x96bbe788361ea619 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666233.849198:0:6650:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c8e90843/0x96bbe788361ea5fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b77 expref: 8 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666233.849229:0:6650:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c8e90843/0x96bbe788361ea5fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b77 expref: 8 pid: 6651 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666233.849250:0:6650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6650:1875552186217344:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788666233.849361:0:6650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab281376480 going to sleep for 11 seconds 00010000:00010000:0.0:1788666233.867740:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666233.869258:0:6650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6650:1875552186217344:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666233.869306:0:6650:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008cd6047d/0x96bbe788361ea619 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666233.877044:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666233.877371:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173638016 00000100:00100000:3.0:1788666233.877389:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173638016 00010000:00010000:3.0:1788666233.877454:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c8e90843/0x96bbe788361ea5fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b77 expref: 9 pid: 6651 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666233.877519:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 70 00000100:00100000:3.0:1788666233.877533:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+9:2364:x1875552173638016:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666233.877557:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666233.877614:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c8e90843/0x96bbe788361ea5fd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b77 expref: 9 pid: 6651 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.877630:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c8e90843/0x96bbe788361ea5fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b77 expref: 9 pid: 6651 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.877660:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8e90843/0x96bbe788361ea5fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b77 expref: 9 pid: 6651 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.877682:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788666233.877686:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788666233.877694:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008cd6047d/0x96bbe788361ea619 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.877717:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cd6047d/0x96bbe788361ea619 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.877768:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666233.877832:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+8:2364:x1875552173638016:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 301us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666233.877841:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 70 00010000:00010000:3.0:1788666233.879316:0:6650:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008cd6047d/0x96bbe788361ea619 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.879340:0:6650:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cd6047d/0x96bbe788361ea619 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.879392:0:6650:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008cd6047d/0x96bbe788361ea619 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.879400:0:6650:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cd6047d/0x96bbe788361ea619 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.879411:0:6650:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cd6047d/0x96bbe788361ea619 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.879419:0:6650:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3600 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666233.879424:0:6650:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cd6047d/0x96bbe788361ea619 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.879433:0:6650:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cd6047d/0x96bbe788361ea619 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.879488:0:6650:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cd6047d/0x96bbe788361ea619 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.879497:0:6650:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cd6047d/0x96bbe788361ea619 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6650 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666233.879635:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173637888:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 Request processed in 31745us (36807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666233.879645:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 58 00000100:00100000:1.0:1788666233.886817:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666233.887197:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173638272 00000100:00100000:3.0:1788666233.887210:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173638272 00000100:00100000:3.0:1788666233.887299:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 186 00000100:00100000:3.0:1788666233.887311:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+17:11538:x1875552173638272:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788666233.887435:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea620 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.887459:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea620 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.887474:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea620 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666233.896516:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea627 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666233.896554:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea5e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b62 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666233.896566:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea627 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666233.898816:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea5e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b62 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666233.898853:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea5e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b62 expref: 18 pid: 5810 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666233.898876:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875552186217472:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788666233.899001:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29885fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788666233.907310:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9fe680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875552186217472:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788666233.907354:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea627 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666233.907964:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666233.908316:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173638400 00000100:00100000:3.0:1788666233.908326:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173638400 00010000:00010000:3.0:1788666233.908376:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea5e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b62 expref: 19 pid: 5810 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666233.908483:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 71 00000100:00100000:3.0:1788666233.908495:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae365880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+19:2364:x1875552173638400:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666233.908521:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666233.908530:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea5e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b62 expref: 19 pid: 5810 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.908546:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea5e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b62 expref: 19 pid: 5810 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.908606:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea5e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b62 expref: 19 pid: 5810 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.908624:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:3.0:1788666233.908631:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea627 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.908642:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea627 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.908649:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea627 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666233.908673:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666233.908750:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae365880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+18:2364:x1875552173638400:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 256us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666233.908758:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 71 00010000:00010000:1.0:1788666233.908942:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea627 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.908952:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea627 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788666233.909497:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1788666233.909762:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1788666233.909824:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1788666233.909960:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae364700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5808:1875552186217600:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788666233.910544:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666233.910667:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28162e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788666233.910818:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186217600 00000100:00100000:0.0:1788666233.910829:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186217600 00000100:00100000:0.0:1788666233.910904:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788666233.910915:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5808:x1875552186217600:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788666233.911237:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae366a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5808:x1875552186217600:12345-0@lo:1000:mdt00_000.0 Request processed in 322us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666233.911248:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788666233.911347:0:5808:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1788666233.911355:0:5808:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab18253f100, transno 4294967315 00000100:00100000:1.0:1788666233.911386:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae364700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5808:1875552186217600:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788666233.912351:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1788666233.912489:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae364700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5808:1875552186217728:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788666233.913509:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666233.913548:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab281253b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788666233.913652:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186217728 00000100:00100000:0.0:1788666233.913660:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186217728 00000100:00100000:0.0:1788666233.913723:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788666233.913736:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5808:x1875552186217728:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788666233.916308:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae364a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5808:x1875552186217728:12345-0@lo:1000:mdt00_000.0 Request processed in 2558us (2785us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788666233.916325:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788666233.916563:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae364700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5808:1875552186217728:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788666233.916654:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea627 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.916666:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea627 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.916676:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea627 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.916695:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144b800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666233.916700:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea627 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.916717:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea627 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.916739:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:1.0:1788666233.916743:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788666233.916749:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea627 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.916757:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea627 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.916807:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea55c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.916814:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea55c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.916839:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea55c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.916845:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666233.916847:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea55c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.916854:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea55c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.916863:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2b9e72b00) 00010000:00010000:1.0:1788666233.916866:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788666233.916869:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea55c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.916874:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff200/0x96bbe788361ea55c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.916909:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea62e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.916931:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea578 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b46 expref: 21 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.916943:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea62e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.916992:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea578 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b46 expref: 21 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.917026:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea578 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b46 expref: 21 pid: 12001 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666233.917047:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae364380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875552186217856:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788666233.918260:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab281253b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788666233.921990:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666233.922171:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae364380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5808:1875552186217856:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788666233.922211:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea62e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666233.922257:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173638528 00000100:00100000:1.0:1788666233.922265:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173638528 00010000:00010000:1.0:1788666233.922302:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea578 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b46 expref: 22 pid: 12001 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666233.922344:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 72 00000100:00100000:1.0:1788666233.922353:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae367b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+22:2363:x1875552173638528:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666233.922372:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666233.922446:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea578 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b46 expref: 22 pid: 12001 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.922459:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea578 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b46 expref: 22 pid: 12001 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.922484:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe400/0x96bbe788361ea578 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b46 expref: 22 pid: 12001 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.922499:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2b9e72b00) 00010000:00010000:1.0:1788666233.922504:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea62e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.922520:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea62e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.922527:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea62e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.922549:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666233.922631:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae367b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+21:2363:x1875552173638528:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 277us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666233.922639:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 72 00010000:00010000:1.0:1788666233.922985:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea62e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.922994:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea62e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.923009:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea62e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.923016:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea62e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.923035:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea62e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.923046:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666233.923056:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea62e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.923068:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea62e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.923086:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2b9e72b00) 00010000:00010000:1.0:1788666233.923089:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666233.923094:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea62e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.923100:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea62e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.923112:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea620 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.923118:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea620 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.923124:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea620 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.923129:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e9200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666233.923132:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea620 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.923137:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea620 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.923143:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2b9e72b00) 00010000:00010000:1.0:1788666233.923146:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788666233.923148:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea620 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.923154:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361ea620 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788666233.923652:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788666233.923658:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788666233.924152:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:1.0:1788666233.924161:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788666233.924284:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae367100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+20:11538:x1875552173638272:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 36969us (37475us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1788666233.924297:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 186 00000020:00080000:1.0:1788666233.924304:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788666233.939834:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666233.939887:0:11980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173638784 00000100:00100000:1.0:1788666233.939902:0:11980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173638784 00000100:00100000:1.0:1788666233.939971:0:11980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:1.0:1788666233.939983:0:11980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28f366450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+20:11538:x1875552173638784:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788666233.943466:0:11980:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788666233.945276:0:11980:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1788666233.945397:0:11980:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea635 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.945418:0:11980:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.945431:0:11980:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.945441:0:11980:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea635 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.945448:0:11980:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea635 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.945462:0:11980:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea635 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666233.945498:0:11980:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788666233.945688:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666233.945696:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea635 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666233.945713:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855400 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:0.0:1788666233.945718:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea635 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666233.945727:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea635 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666233.945751:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8ab2908f2c00) 00010000:00010000:0.0:1788666233.945755:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788666233.945760:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea635 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666233.945766:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855400/0x96bbe788361ea635 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11980 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666233.945866:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666233.945869:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666233.945872:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666233.946219:0:11980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28f366450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+22:11538:x1875552173638784:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 6230us (6390us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788666233.946232:0:11980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 50 00000020:00080000:1.0:1788666233.946238:0:11980:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788666234.890877:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666234.899450:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666234.899505:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666234.899545:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666234.899577:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666234.899719:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666234.899758:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173639424 00000100:00100000:1.0:1788666234.899772:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173639424 00000100:00100000:1.0:1788666234.899846:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173639040 00000100:00100000:1.0:1788666234.899848:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173639040 00000100:00100000:1.0:1788666234.899866:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 162 00000100:00100000:1.0:1788666234.899876:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84416489-fb20-4430-94f5-31470edbb54e+5:2363:x1875552173639424:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666234.899974:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae365500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84416489-fb20-4430-94f5-31470edbb54e+5:2363:x1875552173639424:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 99us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666234.899982:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 162 00000100:00100000:1.0:1788666234.900002:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 163 00000100:00100000:1.0:1788666234.900008:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+22:2363:x1875552173639040:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666234.900305:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173638912 00000100:00100000:3.0:1788666234.900310:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173638912 00000100:00100000:3.0:1788666234.900339:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 300 00000100:00100000:3.0:1788666234.900346:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2363:x1875552173638912:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666234.900374:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290464c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2363:x1875552173638912:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 29us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666234.900380:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 300 00000100:00080000:3.0:1788666234.900437:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666234.900923:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173639168 00000100:00100000:2.0:1788666234.900929:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173639168 00000100:00100000:2.0:1788666234.900965:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173639296 00000100:00100000:2.0:1788666234.900968:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173639296 00000100:00100000:2.0:1788666234.900995:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 96 00000100:00100000:2.0:1788666234.901001:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae366680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173639168:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666234.901135:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae366680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173639168:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 134us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666234.901143:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 96 00000100:00100000:2.0:1788666234.901156:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 97 00000100:00100000:2.0:1788666234.901228:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173639296:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666234.901277:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae364380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173639296:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 116us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666234.901284:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 97 00000100:00080000:2.0:1788666234.901450:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788666234.901850:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae365c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+22:2363:x1875552173639040:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 1838us (2269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666234.901869:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 163 00000040:00080000:1.0:1788666235.872004:0:12482:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788666235.872016:0:12482:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788666235.872056:0:12482:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788666235.872063:0:12482:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1788666235.896531:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1788666235.896550:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1788666235.896556:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:3.0:1788666235.914906:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666236.057639:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666236.059197:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173639680 00000100:00100000:1.0:1788666236.059218:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173639680 00000100:00100000:1.0:1788666236.059326:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 187 00000100:00100000:1.0:1788666236.059339:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+22:11556:x1875552173639680:12345-192.168.201.25@tcp:101:lfs.0 00000100:00080000:2.0:1788666236.059491:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788666236.059678:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666236.059704:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854a00/0x96bbe788361ea63c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b7e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.059833:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea643 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.059849:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea643 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.059863:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea643 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666236.059874:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788666236.060045:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854a00/0x96bbe788361ea63c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b7e expref: 25 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.060078:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea643 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b7e expref: 24 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.060087:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:1.0:1788666236.060090:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788666236.060094:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298854600, rc 0) 00000100:00100000:1.0:1788666236.060215:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+24:11556:x1875552173639680:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 879us (2589us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788666236.060224:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 187 00000100:00100000:3.0:1788666236.066573:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666236.066630:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173639808 00000100:00100000:3.0:1788666236.066640:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173639808 00000100:00100000:3.0:1788666236.066709:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 188 00000100:00100000:3.0:1788666236.066720:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+24:11556:x1875552173639808:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:3.0:1788666236.066810:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea651 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.066828:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea651 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.066842:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea651 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.066859:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9000/0x96bbe788361ea658 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.066876:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9000/0x96bbe788361ea658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.066884:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9000/0x96bbe788361ea658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067148:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea65f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067158:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea65f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067166:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea65f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788666236.067212:0:12001:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea65f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067226:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea651 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067234:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea651 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067241:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea651 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067248:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e9400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666236.067253:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea651 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067261:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea651 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067280:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:3.0:1788666236.067283:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666236.067290:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea651 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067297:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea651 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067307:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9000/0x96bbe788361ea658 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067314:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9000/0x96bbe788361ea658 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067320:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9000/0x96bbe788361ea658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067326:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e9000 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666236.067329:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9000/0x96bbe788361ea658 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067335:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9000/0x96bbe788361ea658 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067343:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab2b9e72700) 00010000:00010000:3.0:1788666236.067345:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666236.067348:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9000/0x96bbe788361ea658 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067354:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9000/0x96bbe788361ea658 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067378:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea65f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067384:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea65f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067391:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea65f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067396:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e8200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666236.067399:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea65f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067406:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea65f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067414:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2b9e72500) 00010000:00010000:3.0:1788666236.067416:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666236.067419:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea65f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.067424:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea65f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666236.067519:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+24:11556:x1875552173639808:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 797us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666236.067529:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 188 00000100:00100000:2.0:1788666236.148196:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666236.149868:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173640064 00000100:00100000:0.0:1788666236.149897:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173640064 00000100:00100000:0.0:1788666236.150298:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 189 00000100:00100000:0.0:1788666236.150314:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+24:11559:x1875552173640064:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788666236.150362:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666236.150400:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea666 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b85 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.150517:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea66d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.150537:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea66d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.150553:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea66d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.150574:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea674 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.150625:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.150633:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.152689:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea67b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.152711:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea67b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.152725:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea67b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666236.152740:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788666236.152854:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea66d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.152862:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea66d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.152869:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea66d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.152875:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144a600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666236.152880:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea66d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.152888:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea66d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.152921:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:0.0:1788666236.152924:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666236.152930:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea66d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.152937:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea66d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.152953:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.152959:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea674 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.152965:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.152971:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144a800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666236.152973:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.152980:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea674 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.152988:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab290a48f00) 00010000:00010000:0.0:1788666236.152990:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666236.152993:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea674 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.153000:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea674 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.153069:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea666 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b85 expref: 27 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.153084:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea67b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b85 expref: 26 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.153091:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab290a48d00) 00010000:00010000:0.0:1788666236.153093:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788666236.153096:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144ae00, rc 0) 00000100:00100000:0.0:1788666236.153178:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4569f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+26:11559:x1875552173640064:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 2867us (4997us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788666236.153187:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 189 00000100:00100000:3.0:1788666236.156355:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666236.156608:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173640192 00000100:00100000:1.0:1788666236.156620:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173640192 00000100:00100000:1.0:1788666236.156717:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 190 00000100:00100000:1.0:1788666236.156729:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+26:11559:x1875552173640192:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:1.0:1788666236.156813:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854a00/0x96bbe788361ea689 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.156831:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854a00/0x96bbe788361ea689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.156844:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854a00/0x96bbe788361ea689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.156874:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854a00/0x96bbe788361ea689 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.156881:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854a00/0x96bbe788361ea689 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.156908:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854a00/0x96bbe788361ea689 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.156914:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298854a00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666236.156919:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854a00/0x96bbe788361ea689 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.156928:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854a00/0x96bbe788361ea689 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.156939:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab290a48d00) 00010000:00010000:1.0:1788666236.156942:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788666236.156947:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854a00/0x96bbe788361ea689 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.156955:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854a00/0x96bbe788361ea689 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666236.157031:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+26:11559:x1875552173640192:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 304us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666236.157039:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 190 00000100:00100000:2.0:1788666236.168975:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666236.169274:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173640448 00000100:00100000:1.0:1788666236.169285:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173640448 00000100:00100000:1.0:1788666236.169346:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:1.0:1788666236.169357:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+26:11559:x1875552173640448:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:1.0:1788666236.169756:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+27:11559:x1875552173640448:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 400us (798us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788666236.169765:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:2.0:1788666236.223006:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666236.223177:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173640704 00000100:00100000:1.0:1788666236.223188:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173640704 00000100:00100000:1.0:1788666236.223254:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 191 00000100:00100000:1.0:1788666236.223264:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+27:11084:x1875552173640704:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788666236.223290:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666236.223312:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854a00/0x96bbe788361ea690 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b8c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.223454:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea697 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.223470:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea67b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b85 expref: 28 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.223480:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea697 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.223516:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea67b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b85 expref: 28 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.223530:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea67b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b85 expref: 28 pid: 7132 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666236.223544:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae364e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5810:1875552186217984:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788666236.223689:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab288577cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666236.227516:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae364e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5810:1875552186217984:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788666236.227555:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea697 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666236.229858:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666236.230078:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173640832 00000100:00100000:3.0:1788666236.230095:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173640832 00010000:00010000:3.0:1788666236.230199:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea67b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b85 expref: 29 pid: 7132 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666236.230334:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 73 00000100:00100000:3.0:1788666236.230357:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+29:2363:x1875552173640832:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666236.230388:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666236.230397:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea67b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b85 expref: 29 pid: 7132 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.230413:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea67b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b85 expref: 29 pid: 7132 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.230444:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea67b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b85 expref: 29 pid: 7132 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.230471:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab290a48d00) 00010000:00010000:3.0:1788666236.230478:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea697 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.230491:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea697 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.231822:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea697 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.231886:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666236.231994:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+28:2363:x1875552173640832:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 1643us (2153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666236.232005:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 73 00010000:00010000:0.0:1788666236.232385:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea697 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.232395:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea697 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666236.232427:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788666236.232625:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854a00/0x96bbe788361ea690 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b8c expref: 29 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.232644:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea697 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b8c expref: 28 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.232653:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab290a48d00) 00010000:00010000:0.0:1788666236.232657:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788666236.232679:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855600, rc 0) 00000100:00100000:0.0:1788666236.232733:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4569500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+28:11084:x1875552173640704:12345-192.168.201.25@tcp:101:bash.0 Request processed in 9471us (9738us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788666236.232741:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 191 00000100:00100000:2.0:1788666236.236343:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666236.239016:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173641088 00000100:00100000:1.0:1788666236.239033:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173641088 00000100:00100000:1.0:1788666236.239114:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 192 00000100:00100000:1.0:1788666236.239125:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+28:11084:x1875552173641088:12345-192.168.201.25@tcp:36:bash.0 00010000:00010000:1.0:1788666236.239812:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea6a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.239832:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.239845:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788666236.239904:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1788666236.239932:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000001c5c452 reply state 0000000076a133e0 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666236.239942:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788666236.239991:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1788666236.240118:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4569180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+32:11084:x1875552173641088:12345-192.168.201.25@tcp:36:bash.0 Request processed in 993us (3785us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1788666236.240127:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 192 00000020:00080000:1.0:1788666236.240132:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788666236.242914:0:3261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea6a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.242942:0:3261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea6a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.242950:0:3261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea6a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.242956:0:3261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298854200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666236.242961:0:3261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea6a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.242970:0:3261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea6a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.242988:0:3261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab290a48d00) 00010000:00010000:3.0:1788666236.242991:0:3261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666236.242996:0:3261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea6a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.243001:0:3261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea6a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666236.243721:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666236.244104:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173641216 00000100:00100000:3.0:1788666236.244117:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173641216 00000100:00100000:3.0:1788666236.244191:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 193 00000100:00100000:3.0:1788666236.244202:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+31:11084:x1875552173641216:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1788666236.244241:0:12001:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666236.244267:0:12001:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9a00/0x96bbe788361ea6ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b93 expref: -99 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.244369:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9a00/0x96bbe788361ea6ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b93 expref: 32 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.244380:0:12001:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9a00/0x96bbe788361ea6ac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b93 expref: 32 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.244395:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab290a48d00) 00010000:00010000:3.0:1788666236.244397:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788666236.244399:0:12001:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e9a00, rc 0) 00000100:00100000:3.0:1788666236.246657:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+32:11084:x1875552173641216:12345-192.168.201.25@tcp:101:bash.0 Request processed in 2445us (2932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666236.246680:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 193 00000100:00100000:2.0:1788666236.257426:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666236.257629:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173641344 00000100:00100000:3.0:1788666236.257641:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173641344 00000100:00100000:3.0:1788666236.257745:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00100000:3.0:1788666236.257756:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae22f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+7:11084:x1875552173641344:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1788666236.257776:0:6651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666236.257801:0:6651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb206275/0x96bbe788361ea6b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42b9a expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788666236.257827:0:6651:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ce178, atime: 0x6a9ce177, ctime: 0x6a9ce178, blocks: 0xb 00010000:00010000:3.0:1788666236.257855:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=342s v=(0 0) 00010000:00010000:3.0:1788666236.257860:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666236.257869:0:6651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb206275/0x96bbe788361ea6b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b9a expref: 8 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.257908:0:6651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fb206275/0x96bbe788361ea6b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b9a expref: 8 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.257933:0:6651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e8200, rc 0) 00000100:00100000:3.0:1788666236.258004:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae22f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+8:11084:x1875552173641344:12345-192.168.201.25@tcp:101:bash.0 Request processed in 250us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666236.258012:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00080000:2.0:1788666236.258778:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788666236.263768:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666236.264186:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173641472 00000100:00100000:3.0:1788666236.264201:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173641472 00002000:00010000:3.0:1788666236.264264:0:6655:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788666236.264269:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab2bf9fe680 with x1875552173641472 ext(0->18446744073709551615) 00002000:00010000:3.0:1788666236.264285:0:6655:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab2bf9fe680. 00000100:00100000:3.0:1788666236.264329:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:3.0:1788666236.264341:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0911d461-5865-4ef7-8c3e-012fc04add58+8:2364:x1875552173641472:12345-192.168.201.25@tcp:10:bash.0 00002000:00010000:3.0:1788666236.265084:0:6655:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788666236.265091:0:6655:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788666232 -> 1788666236 00002000:00010000:3.0:1788666236.265094:0:6655:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788666231 -> 1788666231 00002000:00010000:3.0:1788666236.265096:0:6655:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788666232 -> 1788666236 00002000:00010000:3.0:1788666236.265098:0:6655:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788666236.265243:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0911d461-5865-4ef7-8c3e-012fc04add58+9:2364:x1875552173641472:12345-192.168.201.25@tcp:10:bash.0 Request processed in 900us (1486us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788666236.265254:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00002000:00010000:3.0:1788666236.265259:0:6655:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1788666236.265262:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab2bf9fe680 with x1875552173641472 ext(0->18446744073709551615) 00002000:00010000:3.0:1788666236.265289:0:6655:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab2bf9fe680. 00000100:00100000:1.0:1788666236.304481:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788666236.304698:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788666236.304734:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186218496:0@lo:400:kworker.0 00000100:00100000:3.0:1788666236.304740:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186218240:0@lo:400:kworker.0 00000100:00100000:1.0:1788666236.305315:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186218112:0@lo:400:kworker.0 00000100:00100000:0.0:1788666236.305405:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666236.305551:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186218496 00000100:00100000:0.0:1788666236.305564:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186218496 00000100:00100000:0.0:1788666236.305686:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788666236.305698:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3276:x1875552186218496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666236.305781:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3276:x1875552186218496:12345-0@lo:400:kworker.0 Request processed in 86us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666236.305799:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788666236.305872:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4568700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186218496:0@lo:400:kworker.0 00000100:00080000:0.0:1788666236.305908:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788666236.308034:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186218368:0@lo:400:kworker.0 00000100:00100000:2.0:1788666236.308124:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666236.308196:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788666236.308202:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186218752:0@lo:400:kworker.0 00000100:00100000:2.0:1788666236.308228:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666236.308273:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186218752 00000100:00100000:2.0:1788666236.308284:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186218752 00000100:00100000:0.0:1788666236.308376:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186218624:0@lo:400:kworker.0 00000100:00100000:0.0:1788666236.308409:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666236.308740:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788666236.308752:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186218752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666236.308827:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186218752:12345-0@lo:400:kworker.0 Request processed in 76us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666236.308836:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788666236.308902:0:3278:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1788666236.308942:0:3278:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1788666236.308969:0:3278:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab2bf9fc000, transno 4294967307 00000100:00100000:2.0:1788666236.308987:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4568a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186218752:0@lo:400:kworker.0 00000100:00080000:0.0:1788666236.309493:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788666236.309511:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186218368 00000100:00100000:0.0:1788666236.309518:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186218368 00000100:00100000:0.0:1788666236.309566:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186218624 00000100:00100000:0.0:1788666236.309570:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186218624 00000100:00100000:0.0:1788666236.309619:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788666236.309627:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186218368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666236.309695:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4568380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186218368:12345-0@lo:400:kworker.0 Request processed in 68us (1572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666236.309712:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788666236.309726:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788666236.309732:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186218624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666236.309770:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186218624:12345-0@lo:400:kworker.0 Request processed in 38us (1360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666236.309776:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788666236.309810:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186218624:0@lo:400:kworker.0 00000100:00100000:0.0:1788666236.309841:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4569880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186218368:0@lo:400:kworker.0 00000100:00080000:0.0:1788666236.309857:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666236.310910:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666236.311031:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186218240 00000100:00100000:2.0:1788666236.311043:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186218240 00000100:00100000:2.0:1788666236.311104:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788666236.311115:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186218240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666236.311196:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186218240:12345-0@lo:400:kworker.0 Request processed in 85us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666236.311204:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788666236.311280:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186218240:0@lo:400:kworker.0 00000100:00100000:1.0:1788666236.313969:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666236.314307:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186218112 00000100:00100000:3.0:1788666236.314320:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186218112 00000100:00100000:3.0:1788666236.314406:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788666236.314421:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186218112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666236.314537:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290466050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186218112:12345-0@lo:400:kworker.0 Request processed in 120us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666236.314546:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788666236.314932:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186218112:0@lo:400:kworker.0 00000100:00100000:1.0:1788666236.335427:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666236.335520:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173641600 00000100:00100000:0.0:1788666236.345912:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173641600 00000100:00100000:0.0:1788666236.346024:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 194 00000100:00100000:0.0:1788666236.346036:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+32:11573:x1875552173641600:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:0.0:1788666236.346115:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea6ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.346134:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea6ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.346148:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea6ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.346163:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea6c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.346169:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.346194:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.346429:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea6c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.346439:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.346447:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788666236.346488:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.346500:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea6ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.346507:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea6ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.346513:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea6ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.346519:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144a800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666236.346523:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea6ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.346530:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea6ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.346548:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:0.0:1788666236.347034:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666236.347042:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea6ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.347050:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea6ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.347066:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.347071:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea6c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.347078:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.347084:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144a600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666236.347087:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.347093:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea6c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.347101:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab290a48f00) 00010000:00010000:0.0:1788666236.347104:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666236.347106:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea6c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.347111:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea6c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.347126:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.347139:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea6c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.347157:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.347162:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144b800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666236.347165:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.347171:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea6c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.347180:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab290a48d00) 00010000:00010000:0.0:1788666236.347182:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666236.347185:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea6c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.347191:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea6c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666236.347291:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae364e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+32:11573:x1875552173641600:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 1254us (11885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666236.347300:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 194 00000100:00100000:2.0:1788666236.409113:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666236.409551:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173641856 00000100:00100000:3.0:1788666236.409566:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173641856 00000100:00100000:3.0:1788666236.409693:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 195 00000100:00100000:3.0:1788666236.409705:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+32:11576:x1875552173641856:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1788666236.409741:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666236.409770:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9000/0x96bbe788361ea6cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42ba1 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.409880:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea6d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.409900:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.409915:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.409963:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8c00/0x96bbe788361ea6dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.409971:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8c00/0x96bbe788361ea6dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.409977:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8c00/0x96bbe788361ea6dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.410766:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361ea6e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.410781:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361ea6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.410791:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361ea6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666236.410805:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788666236.410949:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.410958:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea6d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.410966:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.410973:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e9400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666236.410979:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.411011:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea6d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.411027:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:3.0:1788666236.411031:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666236.411037:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea6d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.411044:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea6d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.414783:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8c00/0x96bbe788361ea6dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.414810:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8c00/0x96bbe788361ea6dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.414820:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8c00/0x96bbe788361ea6dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.414828:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e8c00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666236.414833:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8c00/0x96bbe788361ea6dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.414842:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8c00/0x96bbe788361ea6dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.414865:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab2b9e72300) 00010000:00010000:3.0:1788666236.414869:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666236.414875:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8c00/0x96bbe788361ea6dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.414914:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8c00/0x96bbe788361ea6dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.415004:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9000/0x96bbe788361ea6cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ba1 expref: 35 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.415020:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361ea6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ba1 expref: 34 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.415028:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab290a48d00) 00010000:00010000:3.0:1788666236.415031:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788666236.415033:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e9e00, rc 0) 00000100:00100000:3.0:1788666236.415545:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+34:11576:x1875552173641856:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 5837us (6450us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1788666236.415555:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 195 00000100:00100000:2.0:1788666236.427674:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666236.427791:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173641984 00000100:00100000:1.0:1788666236.427830:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173641984 00000100:00100000:1.0:1788666236.427935:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 196 00000100:00100000:1.0:1788666236.427948:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+34:11576:x1875552173641984:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:1.0:1788666236.428074:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea6f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.428098:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea697 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b8c expref: 34 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.428110:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea6f2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.428162:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea697 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b8c expref: 34 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.428179:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea697 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b8c expref: 34 pid: 5810 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666236.428197:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae364000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5810:1875552186218880:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788666236.428373:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab288577900 going to sleep for 11 seconds 00000100:00100000:1.0:1788666236.440282:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666236.440541:0:11980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173642240 00000100:00100000:3.0:1788666236.440569:0:11980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173642240 00000100:00100000:3.0:1788666236.440737:0:11980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:0.0:1788666236.440737:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae364000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5810:1875552186218880:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788666236.440760:0:11980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+35:5600:x1875552173642240:12345-192.168.201.25@tcp:35:ldlm_bl.0 00010000:00010000:0.0:1788666236.440784:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea6f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666236.441487:0:11980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+36:5600:x1875552173642240:12345-192.168.201.25@tcp:35:ldlm_bl.0 Request processed in 732us (1219us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788666236.441497:0:11980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:2.0:1788666236.449882:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666236.450026:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173642368 00000100:00100000:3.0:1788666236.450037:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173642368 00010000:00010000:3.0:1788666236.450083:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea697 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b8c expref: 36 pid: 5810 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666236.450156:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 74 00000100:00100000:3.0:1788666236.450167:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4569c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+36:2363:x1875552173642368:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666236.450185:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666236.450192:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea697 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b8c expref: 36 pid: 5810 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.450398:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea697 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b8c expref: 36 pid: 5810 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.450427:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea697 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b8c expref: 36 pid: 5810 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.450446:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab290a48d00) 00010000:00010000:3.0:1788666236.450451:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea6f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.450462:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea6f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.450470:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea6f2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.450504:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788666236.450673:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea6f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.450691:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea6f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.450723:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea6f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.450731:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea6f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.450739:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea6f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.450745:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855e00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666236.450749:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea6f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.450756:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea6f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.450766:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab290a48d00) 00010000:00010000:0.0:1788666236.450769:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788666236.450772:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea6f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.450779:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855e00/0x96bbe788361ea6f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666236.450834:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4568a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+35:11576:x1875552173641984:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 22888us (23193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666236.450845:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 196 00000100:00100000:3.0:1788666236.453401:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4569c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+34:2363:x1875552173642368:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 3212us (3507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666236.453422:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 74 00000100:00100000:2.0:1788666236.453764:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666236.454998:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173642624 00000100:00100000:1.0:1788666236.455025:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173642624 00000100:00100000:1.0:1788666236.455106:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 53 00000100:00100000:1.0:1788666236.455118:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+34:11576:x1875552173642624:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:1.0:1788666236.455680:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+35:11576:x1875552173642624:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 562us (1914us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788666236.455690:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 53 00000100:00100000:2.0:1788666236.552181:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666236.552343:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173642880 00000100:00100000:0.0:1788666236.552355:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173642880 00000100:00100000:0.0:1788666236.552425:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 197 00000100:00100000:0.0:1788666236.552435:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+35:11587:x1875552173642880:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:0.0:1788666236.552466:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666236.552490:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea6f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42ba8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.552652:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea700 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.552678:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea700 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.552689:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea700 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.552707:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea707 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.552715:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.552722:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.553039:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea70e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.553050:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea70e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.553069:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea70e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666236.553080:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788666236.553191:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea700 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.553215:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea700 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.553222:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea700 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.553229:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144a800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666236.553234:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea700 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.553243:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea700 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.553256:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:0.0:1788666236.553259:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666236.553264:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea700 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.553269:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea700 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.553283:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea707 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.553288:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea707 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.553300:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.553304:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144ae00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666236.553307:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea707 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.553312:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea707 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.553320:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab290a48f00) 00010000:00010000:0.0:1788666236.553322:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666236.553324:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea707 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.553328:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea707 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.553373:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea6f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ba8 expref: 38 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.553386:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea70e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ba8 expref: 37 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.553393:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab290a48d00) 00010000:00010000:0.0:1788666236.553395:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788666236.553398:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144b800, rc 0) 00000100:00100000:0.0:1788666236.553488:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4569880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+37:11587:x1875552173642880:12345-192.168.201.25@tcp:101:cat.0 Request processed in 1054us (1317us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788666236.553506:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 197 00000100:00100000:3.0:1788666236.559723:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666236.559867:0:11980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173643136 00000100:00100000:1.0:1788666236.559880:0:11980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173643136 00000100:00100000:1.0:1788666236.559950:0:11980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 54 00000100:00100000:1.0:1788666236.559959:0:11980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+37:11587:x1875552173643136:12345-192.168.201.25@tcp:35:cat.0 00000100:00100000:1.0:1788666236.560256:0:11980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+38:11587:x1875552173643136:12345-192.168.201.25@tcp:35:cat.0 Request processed in 297us (550us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788666236.560264:0:11980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 54 00000100:00100000:3.0:1788666236.590495:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666236.590681:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173643392 00000100:00100000:2.0:1788666236.590692:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173643392 00000100:00100000:2.0:1788666236.590770:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 198 00000100:00100000:2.0:1788666236.590781:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+38:11588:x1875552173643392:12345-192.168.201.25@tcp:36:rm.0 00010000:00010000:2.0:1788666236.590866:0:7132:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788666236.590902:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea70e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ba8 expref: 38 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.590930:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361ea6e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ba1 expref: 37 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.590967:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9a00/0x96bbe788361ea6ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b93 expref: 36 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.590979:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab290a48d00) 00010000:00010000:2.0:1788666236.590992:0:7132:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788666236.591032:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea71c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.591046:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea71c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.591056:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea71c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.591072:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea723 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.591080:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.591087:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.591365:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea72a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.591374:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea72a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.591381:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea72a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788666236.592415:0:7132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:2.0:1788666236.592431:0:7132:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343300850374ns, next at 344300846154ns, rc = 0 00010000:00010000:2.0:1788666236.592510:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea731 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.592523:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea731 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.592532:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea731 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.592540:0:7132:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea731 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.592547:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea731 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.592554:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea731 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.592639:0:7132:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666236.592674:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea72a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.592680:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea72a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.592687:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea72a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.592694:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666236.592707:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea72a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.592715:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea72a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.592729:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2a088e700) 00010000:00010000:2.0:1788666236.592732:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788666236.592737:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea72a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.592743:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea72a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.592764:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea71c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.592771:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea71c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.592776:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea71c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.592782:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2a00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666236.592784:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea71c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.592790:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea71c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.592797:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:2.0:1788666236.592799:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666236.592808:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea71c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.592815:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea71c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788666236.592826:0:7132:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f2a6832 reply state 0000000008bd988b transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666236.592835:0:7132:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788666236.592950:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+37:11588:x1875552173643392:12345-192.168.201.25@tcp:36:rm.0 Request processed in 2167us (2461us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788666236.592959:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 198 00010000:00010000:0.0:1788666236.594807:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666236.594818:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea731 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.594829:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2600 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:0.0:1788666236.594833:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea731 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.594842:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea731 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.594859:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8ab2a088e700) 00010000:00010000:0.0:1788666236.594862:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788666236.594866:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea731 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.594872:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2600/0x96bbe788361ea731 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.594893:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666236.594895:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666236.594897:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666236.596190:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea723 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.596216:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea723 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.596224:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea723 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.596231:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666236.596235:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea723 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.596243:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea723 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.596260:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab2a088e400) 00010000:00010000:3.0:1788666236.596263:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666236.596267:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea723 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.596273:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3600/0x96bbe788361ea723 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666236.641707:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666236.642795:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173643648 00000100:00100000:0.0:1788666236.642810:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173643648 00000100:00100000:0.0:1788666236.642887:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 199 00000100:00100000:0.0:1788666236.642898:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+36:11594:x1875552173643648:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:0.0:1788666236.642924:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666236.642944:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea738 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42baf expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.643114:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea73f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.643132:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea73f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.643146:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea73f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.643705:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea746 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.643716:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.643724:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788666236.644374:0:5810:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788666236.644838:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea74d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.644854:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea74d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.644868:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea74d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.644924:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea73f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.644942:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea73f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.644951:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea73f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.644958:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144ae00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666236.644967:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea73f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.644977:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea73f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.644996:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:2.0:1788666236.644999:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666236.645006:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea73f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.645012:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea73f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788666236.645027:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000518cd234 reply state 00000000be41369d transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666236.645040:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788666236.645089:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea738 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42baf expref: 39 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.645107:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea74d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42baf expref: 38 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.645127:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab2a088e900) 00010000:00010000:2.0:1788666236.645130:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666236.645133:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2200, rc 0) 00000100:00100000:2.0:1788666236.645753:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+39:11594:x1875552173643648:12345-192.168.201.25@tcp:101:bash.0 Request processed in 2850us (4052us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788666236.645766:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 199 00010000:00010000:1.0:1788666236.651381:0:3261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.651409:0:3261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea746 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.651419:0:3261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea746 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.651427:0:3261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2a00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666236.651433:0:3261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea746 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.651442:0:3261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea746 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.651465:0:3261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab290a48f00) 00010000:00010000:1.0:1788666236.651468:0:3261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666236.651474:0:3261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea746 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.651480:0:3261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2a00/0x96bbe788361ea746 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666236.654182:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666236.654894:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173643776 00000100:00100000:0.0:1788666236.654908:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173643776 00000100:00100000:0.0:1788666236.655001:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00080000:2.0:1788666236.655087:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788666236.655128:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+5:2363:x1875552173643776:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:0.0:1788666236.655149:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666236.655170:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8e90843/0x96bbe788361ea75b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42bb6 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788666236.655267:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788666236.655299:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=343s v=(0 0) 00010000:00010000:0.0:1788666236.655304:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788666236.655316:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8e90843/0x96bbe788361ea75b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bb6 expref: 6 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.655338:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c8e90843/0x96bbe788361ea75b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bb6 expref: 6 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.655352:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144a800, rc 0) 00000100:00100000:0.0:1788666236.655533:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173643776:12345-192.168.201.25@tcp:101:bash.0 Request processed in 408us (1364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666236.655541:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:2.0:1788666236.662157:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666236.662313:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173643904 00000100:00100000:3.0:1788666236.662330:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173643904 00000100:00100000:3.0:1788666236.662407:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:3.0:1788666236.662420:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+6:11594:x1875552173643904:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:3.0:1788666236.662467:0:6651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666236.662487:0:6651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019d2ad77/0x96bbe788361ea762 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42bbd expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.662525:0:6651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8e90843/0x96bbe788361ea75b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bb6 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.662535:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666236.662540:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666236.662546:0:6651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019d2ad77/0x96bbe788361ea762 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bbd expref: 7 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.662630:0:6651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c8e90843/0x96bbe788361ea75b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bb6 expref: 7 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.662642:0:6651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c8e90843/0x96bbe788361ea75b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bb6 expref: 7 pid: 8429 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666236.662665:0:6651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6651:1875552186219008:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788666236.662797:0:6651:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788666236.668704:0:6651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaaea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6651:1875552186219008:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788666236.668755:0:6651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019d2ad77/0x96bbe788361ea762 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bbd expref: 7 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.668783:0:6651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e9c00, rc 0) 00000100:00100000:3.0:1788666236.668885:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+7:11594:x1875552173643904:12345-192.168.201.25@tcp:101:bash.0 Request processed in 6467us (6739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666236.668896:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:1.0:1788666236.669086:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666236.669478:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173644032 00000100:00100000:3.0:1788666236.669488:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173644032 00010000:00010000:3.0:1788666236.669521:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c8e90843/0x96bbe788361ea75b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bb6 expref: 7 pid: 8429 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666236.669569:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 75 00000100:00100000:3.0:1788666236.669612:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a096c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+7:2364:x1875552173644032:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666236.669628:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666236.669652:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c8e90843/0x96bbe788361ea75b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bb6 expref: 7 pid: 8429 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.669677:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c8e90843/0x96bbe788361ea75b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bb6 expref: 7 pid: 8429 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.669703:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8e90843/0x96bbe788361ea75b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bb6 expref: 7 pid: 8429 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.669718:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666236.669723:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666236.669732:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019d2ad77/0x96bbe788361ea762 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bbd expref: 6 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.669741:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019d2ad77/0x96bbe788361ea762 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bbd expref: 6 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.669788:0:5793:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000019d2ad77/0x96bbe788361ea762 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bbd expref: 6 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666236.669804:0:5793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfaaea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5793:1875552186219136:192.168.201.25@tcp:105: 00000100:00100000:3.0:1788666236.669885:0:5793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788666236.673684:0:5793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfaaea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5793:1875552186219136:192.168.201.25@tcp:105: 00010000:00010000:3.0:1788666236.673716:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666236.673783:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a096c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:2364:x1875552173644032:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 4203us (4695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666236.673798:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 75 00000100:00100000:0.0:1788666236.677979:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666236.678075:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173644288 00000100:00100000:2.0:1788666236.678086:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173644288 00000100:00100000:2.0:1788666236.678147:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 55 00000100:00100000:2.0:1788666236.678156:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+38:11594:x1875552173644288:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:2.0:1788666236.678648:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+39:11594:x1875552173644288:12345-192.168.201.25@tcp:35:bash.0 Request processed in 490us (676us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788666236.678666:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 55 00000100:00100000:2.0:1788666236.811219:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186219264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788666236.811356:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666236.811688:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186219264 00000100:00100000:1.0:1788666236.811698:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186219264 00000100:00100000:1.0:1788666236.811756:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788666236.811766:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4568700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186219264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788666236.811806:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666236.811867:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4568700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186219264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666236.811876:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788666236.812262:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186219264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788666236.936979:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666236.937164:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173644416 00000100:00100000:3.0:1788666236.937174:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173644416 00000100:00100000:3.0:1788666236.937240:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 200 00000100:00100000:3.0:1788666236.937249:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+39:11610:x1875552173644416:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1788666236.937275:0:12001:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666236.937296:0:12001:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9000/0x96bbe788361ea769 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42bc4 expref: -99 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.937361:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8c00/0x96bbe788361ea770 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.937380:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8c00/0x96bbe788361ea770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.937395:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8c00/0x96bbe788361ea770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666236.937457:0:12001:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788666236.937462:0:12001:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788666236.937485:0:12001:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8c00/0x96bbe788361ea770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.937518:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9000/0x96bbe788361ea769 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bc4 expref: 41 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.937539:0:12001:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8c00/0x96bbe788361ea770 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bc4 expref: 40 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.937549:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:3.0:1788666236.937554:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788666236.937559:0:12001:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e8c00, rc 0) 00000100:00100000:3.0:1788666236.937738:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4568000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+40:11610:x1875552173644416:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 489us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666236.937746:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 200 00010000:00010000:3.0:1788666236.941158:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666236.948291:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666236.948523:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173644672 00000100:00100000:2.0:1788666236.948536:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173644672 00000100:00100000:2.0:1788666236.948664:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 201 00000100:00100000:2.0:1788666236.948678:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfaaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+40:11610:x1875552173644672:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666236.948711:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666236.948769:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea777 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42bcb expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.948889:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea77e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.948905:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea77e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.948920:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea77e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666236.948932:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788666236.950232:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea777 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bcb expref: 43 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.950262:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea77e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bcb expref: 42 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666236.950272:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab2a088e900) 00010000:00010000:2.0:1788666236.950275:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666236.950279:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2c00, rc 0) 00000100:00100000:2.0:1788666236.950388:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfaaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+42:11610:x1875552173644672:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1712us (2113us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788666236.950398:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 201 00000100:00100000:2.0:1788666236.957802:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666236.957862:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666236.957929:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173645056 00000100:00100000:3.0:1788666236.957945:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173645056 00000100:00100000:3.0:1788666236.958042:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:3.0:1788666236.958055:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+42:2361:x1875552173645056:12345-192.168.201.25@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788666236.958066:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173644928 00000100:00100000:1.0:1788666236.958072:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173644928 00010000:00010000:3.0:1788666236.958079:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666236.958113:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea77e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bcb expref: 43 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666236.958126:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 202 00000100:00100000:1.0:1788666236.958136:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+43:11610:x1875552173644928:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:1.0:1788666236.958162:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666236.958179:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab2a088e900) 00010000:00010000:1.0:1788666236.958180:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea78c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42bd2 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.958188:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666236.958265:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+43:2361:x1875552173645056:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 213us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666236.958274:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00010000:00010000:1.0:1788666236.958307:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea793 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.958327:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.958341:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea793 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666236.958358:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788666236.958533:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855c00/0x96bbe788361ea78c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bd2 expref: 44 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.958558:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea793 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bd2 expref: 43 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.958566:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab2a088e900) 00010000:00010000:1.0:1788666236.958569:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788666236.958572:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855200, rc 0) 00000100:00100000:1.0:1788666236.958667:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4569c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+43:11610:x1875552173644928:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 533us (804us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788666236.958674:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 202 00000100:00100000:2.0:1788666236.968756:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666236.972621:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173645184 00000100:00100000:3.0:1788666236.972642:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173645184 00000100:00100000:3.0:1788666236.972797:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 62 00000100:00100000:3.0:1788666236.972810:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+6:2363:x1875552173645184:12345-192.168.201.25@tcp:1:lfs.0 00010000:00010000:3.0:1788666236.973809:0:6649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095ee39e3/0x96bbe788361ea7a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.973875:0:6649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019d2ad77/0x96bbe788361ea762 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bbd expref: 6 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.973888:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666236.973894:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788666236.973900:0:6649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095ee39e3/0x96bbe788361ea7a1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.973979:0:6649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019d2ad77/0x96bbe788361ea762 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bbd expref: 6 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666236.973998:0:6649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019d2ad77/0x96bbe788361ea762 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bbd expref: 6 pid: 6651 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666236.974084:0:6649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae278e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6649:1875552186219392:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788666236.974231:0:6649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b7780 going to sleep for 11 seconds 00000100:00100000:0.0:1788666236.985370:0:6649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae278e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6649:1875552186219392:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788666236.985405:0:6649:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000095ee39e3/0x96bbe788361ea7a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666236.988823:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666236.988952:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173645312 00000100:00100000:0.0:1788666236.988967:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173645312 00002000:00100000:0.0:1788666236.989042:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8ab2aea1d880 x1875552173645312/t0(0) o4->0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp:277/0 lens 504/0 e 0 to 0 dl 1788666247 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788666236.989064:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab2aea1d880 with x1875552173645312 ext(0->8) 00010000:00010000:0.0:1788666236.989076:0:6656:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000019d2ad77/0x96bbe788361ea762 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bbd expref: 7 pid: 6651 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666236.989096:0:6656:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000019d2ad77/0x96bbe788361ea762 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bbd expref: 7 pid: 6651 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788666236.989106:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ab2aea1d880 00000100:00100000:0.0:1788666236.989144:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:0.0:1788666236.989155:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0911d461-5865-4ef7-8c3e-012fc04add58+7:2364:x1875552173645312:12345-192.168.201.25@tcp:4:lfs.0 00000100:00100000:1.0:1788666236.997961:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0911d461-5865-4ef7-8c3e-012fc04add58+9:2364:x1875552173645312:12345-192.168.201.25@tcp:4:lfs.0 Request processed in 8777us (9122us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788666236.997980:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 3 00002000:00100000:1.0:1788666236.997995:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8ab2aea1d880 x1875552173645312/t4294967308(0) o4->0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp:277/0 lens 504/448 e 0 to 0 dl 1788666247 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788666236.998006:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab2aea1d880 with x1875552173645312 ext(0->8) 00010000:00010000:1.0:1788666236.998019:0:6656:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000019d2ad77/0x96bbe788361ea762 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bbd expref: 9 pid: 6651 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666236.998042:0:6656:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000019d2ad77/0x96bbe788361ea762 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bbd expref: 9 pid: 6651 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788666236.998061:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8ab2aea1d880 00000100:00100000:3.0:1788666237.007747:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666237.007891:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173645440 00000100:00100000:2.0:1788666237.007925:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173645440 00010000:00010000:2.0:1788666237.007978:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019d2ad77/0x96bbe788361ea762 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bbd expref: 9 pid: 6651 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666237.008037:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 76 00000100:00100000:2.0:1788666237.008050:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae278e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+9:2363:x1875552173645440:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788666237.008070:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788666237.008096:0:5793:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788666237.008100:0:5793:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788666237 00002000:00010000:2.0:1788666237.008102:0:5793:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788666237 00002000:00010000:2.0:1788666237.008105:0:5793:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788666237 00010000:00010000:2.0:1788666237.008112:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019d2ad77/0x96bbe788361ea762 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bbd expref: 9 pid: 6651 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.008128:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019d2ad77/0x96bbe788361ea762 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bbd expref: 9 pid: 6651 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.008156:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019d2ad77/0x96bbe788361ea762 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bbd expref: 9 pid: 6651 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.008177:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788666237.008181:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788666237.008187:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000095ee39e3/0x96bbe788361ea7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.008197:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000095ee39e3/0x96bbe788361ea7a1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.008247:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666237.008332:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae278e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+8:2363:x1875552173645440:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 285us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666237.008342:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 76 00010000:00010000:1.0:1788666237.010414:0:6649:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000095ee39e3/0x96bbe788361ea7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666237.010477:0:6649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000095ee39e3/0x96bbe788361ea7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666237.010533:0:6649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000095ee39e3/0x96bbe788361ea7a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666237.010543:0:6649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000095ee39e3/0x96bbe788361ea7a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666237.010555:0:6649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000095ee39e3/0x96bbe788361ea7a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666237.010562:0:6649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e9000 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:1.0:1788666237.010567:0:6649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000095ee39e3/0x96bbe788361ea7a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666237.010577:0:6649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000095ee39e3/0x96bbe788361ea7a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666237.010639:0:6649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000095ee39e3/0x96bbe788361ea7a1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666237.010657:0:6649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095ee39e3/0x96bbe788361ea7a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666237.010810:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173645184:12345-192.168.201.25@tcp:1:lfs.0 Request processed in 37997us (42063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666237.010821:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 62 00000040:00080000:0.0:1788666237.011973:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788666237.011982:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788666237.012024:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788666237.012030:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788666237.019482:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666237.019811:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173645696 00000100:00100000:0.0:1788666237.019823:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173645696 00000100:00100000:0.0:1788666237.019963:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 56 00000100:00100000:0.0:1788666237.019976:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28f366850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+43:11610:x1875552173645696:12345-192.168.201.25@tcp:35:lfs.0 00000004:00010000:0.0:1788666237.020061:0:5811:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea793 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bd2 expref: 43 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788666237.020704:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:0.0:1788666237.020754:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1788666237.024679:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1788666237.024831:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea7a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666237.024862:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea74d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42baf expref: 47 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666237.024876:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea7a8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666237.025124:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea74d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42baf expref: 47 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666237.025147:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea74d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42baf expref: 47 pid: 5810 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666237.025373:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2988ff480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5811:1875552186219520:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788666237.025635:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b7840 going to sleep for 11 seconds 00000100:00100000:1.0:1788666237.032731:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2988ff480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5811:1875552186219520:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788666237.032772:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea7a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666237.037793:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666237.038211:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173645824 00000100:00100000:0.0:1788666237.038226:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173645824 00010000:00010000:0.0:1788666237.038295:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea74d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42baf expref: 48 pid: 5810 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666237.038343:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 77 00000100:00100000:0.0:1788666237.038352:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+48:2364:x1875552173645824:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788666237.038383:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666237.038391:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea74d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42baf expref: 48 pid: 5810 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.038405:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea74d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42baf expref: 48 pid: 5810 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.038432:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea74d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42baf expref: 48 pid: 5810 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.038454:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab2a088e900) 00010000:00010000:0.0:1788666237.038461:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea7a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.038504:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea7a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.038513:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea7a8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.038552:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666237.038647:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+47:2364:x1875552173645824:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 295us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666237.038665:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 77 00010000:00010000:1.0:1788666237.038926:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea7a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666237.038935:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea7a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788666237.039096:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788666237.039430:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1788666237.039642:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae367800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5811:1875552186219648:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788666237.039794:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666237.039851:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab282bcb180 going to sleep for 11 seconds 00000100:00100000:3.0:1788666237.040137:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186219648 00000100:00100000:3.0:1788666237.040146:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186219648 00000100:00100000:3.0:1788666237.043503:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788666237.043541:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5811:x1875552186219648:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788666237.043862:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae366680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5811:x1875552186219648:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 338us (4066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666237.043871:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788666237.044567:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae367800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5811:1875552186219648:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788666237.047407:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1788666237.047540:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea1ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5811:1875552186219776:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788666237.047660:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666237.047696:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab1811650c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666237.047712:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186219776 00000100:00100000:1.0:1788666237.047724:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186219776 00000100:00100000:1.0:1788666237.047822:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788666237.047835:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5811:x1875552186219776:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788666237.048270:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5811:x1875552186219776:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 436us (619us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788666237.048281:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788666237.048422:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea1ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5811:1875552186219776:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788666237.048483:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1788666237.048526:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea7a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.048539:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea7a8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.048550:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea7a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.048556:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e9400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666237.048562:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea7a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.048572:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea7a8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.048639:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab2a088e900) 00010000:00010000:2.0:1788666237.048643:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788666237.048659:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea7a8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.048667:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9400/0x96bbe788361ea7a8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788666237.048850:0:5811:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788666237.051525:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1788666237.051558:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343759976596ns, next at 344759971352ns, rc = 0 00000001:00080000:2.0:1788666237.051597:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1788666237.051701:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab2a088e900) 00010000:00010000:2.0:1788666237.051706:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788666237.051719:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea793 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bd2 expref: 51 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666237.051893:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28f366850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+50:11610:x1875552173645696:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 31917us (32419us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1788666237.051907:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 56 00000020:00080000:2.0:1788666237.051915:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788666237.055836:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666237.056176:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173645952 00000100:00100000:0.0:1788666237.056186:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173645952 00000100:00100000:0.0:1788666237.056262:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 203 00000100:00100000:0.0:1788666237.056274:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+50:11610:x1875552173645952:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788666237.056301:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666237.056324:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea7af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42bd9 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.056400:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea7af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bd9 expref: 51 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.056415:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea7af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bd9 expref: 51 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.056436:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:0.0:1788666237.056440:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788666237.056456:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144b800, rc 0) 00000100:00100000:0.0:1788666237.056538:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+51:11610:x1875552173645952:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 267us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666237.056545:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 203 00000100:00100000:3.0:1788666237.059184:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666237.059361:0:11980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173646208 00000100:00100000:1.0:1788666237.059396:0:11980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173646208 00000100:00100000:1.0:1788666237.059469:0:11980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:1.0:1788666237.059481:0:11980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+51:11610:x1875552173646208:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:1.0:1788666237.060031:0:11980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+52:11610:x1875552173646208:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 541us (850us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1788666237.060042:0:11980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 57 00000100:00100000:1.0:1788666237.155496:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666237.155634:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173646336 00000100:00100000:0.0:1788666237.155655:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173646336 00000100:00100000:0.0:1788666237.155711:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 204 00000100:00100000:0.0:1788666237.155722:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+52:11620:x1875552173646336:12345-192.168.201.25@tcp:34:lfs.0 00010000:00010000:0.0:1788666237.155813:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea7b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.155847:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea7b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.155861:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea7b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.155878:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea7bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.155886:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea7bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.155893:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea7bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.155986:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea7c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.155994:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.156001:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788666237.156054:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.156069:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea7b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.156076:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea7b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.156083:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea7b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.156089:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144a800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666237.156093:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea7b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.156101:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea7b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.156112:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:0.0:1788666237.156116:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666237.156121:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea7b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.156127:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea7b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.156141:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea7bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.156147:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea7bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.156158:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea7bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.156164:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144ae00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666237.156167:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea7bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.156173:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea7bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.156182:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab290a48500) 00010000:00010000:0.0:1788666237.156184:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666237.156187:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea7bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.156192:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea7bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.156207:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea7c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.156213:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea7c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.156218:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea7c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.156224:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144a600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666237.156226:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea7c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.156241:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea7c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.156249:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:0.0:1788666237.156251:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666237.156255:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea7c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.156261:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea7c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666237.156348:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae364380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+52:11620:x1875552173646336:12345-192.168.201.25@tcp:34:lfs.0 Request processed in 627us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666237.156358:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 204 00000100:00100000:3.0:1788666237.235431:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666237.235512:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173646592 00000100:00100000:2.0:1788666237.235526:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173646592 00000100:00100000:2.0:1788666237.235625:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 205 00000100:00100000:2.0:1788666237.235636:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+52:11623:x1875552173646592:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666237.235669:0:12001:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666237.235693:0:12001:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea7cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42be0 expref: -99 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.235794:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea7d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.235811:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea7d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.235823:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea7d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.235837:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea7d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.235844:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.235851:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.235985:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea7e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.235994:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.236001:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea7e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666237.236011:0:12001:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788666237.236111:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea7d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.236118:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea7d2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.236132:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea7d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.236138:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2e00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666237.236142:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea7d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.236150:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea7d2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.236186:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:2.0:1788666237.236189:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666237.236195:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea7d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.236201:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea7d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.236217:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea7d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.236223:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea7d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.236228:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea7d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.236233:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666237.236236:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea7d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.236263:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea7d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.236272:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab2a088e900) 00010000:00010000:2.0:1788666237.236275:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666237.236278:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea7d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.236284:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea7d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.236333:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea7cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42be0 expref: 55 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.236348:0:12001:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea7e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42be0 expref: 54 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.236356:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:2.0:1788666237.236369:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666237.236373:0:12001:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2400, rc 0) 00000100:00100000:2.0:1788666237.236456:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+54:11623:x1875552173646592:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 822us (1037us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788666237.236465:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 205 00000100:00100000:3.0:1788666237.247066:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666237.247310:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173646720 00000100:00100000:2.0:1788666237.247325:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173646720 00000100:00100000:2.0:1788666237.247783:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 206 00000100:00100000:2.0:1788666237.247798:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+54:11623:x1875552173646720:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:2.0:1788666237.247921:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea7ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.247943:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea7ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.247958:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea7ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.247991:0:7132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea7ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.247999:0:7132:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea7ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.248008:0:7132:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea7ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.248014:0:7132:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666237.248019:0:7132:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea7ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.248026:0:7132:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea7ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.248039:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:2.0:1788666237.248042:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788666237.248048:0:7132:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea7ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.248054:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2200/0x96bbe788361ea7ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666237.248422:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+54:11623:x1875552173646720:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 359us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666237.248434:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 206 00000100:00100000:1.0:1788666237.251418:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666237.252274:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173646976 00000100:00100000:2.0:1788666237.252293:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173646976 00000100:00100000:2.0:1788666237.252383:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 58 00000100:00100000:2.0:1788666237.252395:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+54:11623:x1875552173646976:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1788666237.252765:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae365180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+55:11623:x1875552173646976:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 372us (1364us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788666237.252774:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 58 00000100:00100000:3.0:1788666237.429819:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666237.430038:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173647232 00000100:00100000:1.0:1788666237.430051:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173647232 00000100:00100000:1.0:1788666237.430134:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 207 00000100:00100000:1.0:1788666237.430149:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+55:11633:x1875552173647232:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:1.0:1788666237.430202:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666237.430206:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788666237.430261:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8c00/0x96bbe788361ea770 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bc4 expref: 55 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666237.430296:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:1.0:1788666237.430305:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788666237.430327:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea7f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42be7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666237.430726:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea7fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666237.430742:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea7fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666237.430775:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea7fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666237.430795:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788666237.430954:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854e00/0x96bbe788361ea7f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42be7 expref: 57 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666237.430971:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea7fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42be7 expref: 56 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666237.430979:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:1.0:1788666237.430983:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788666237.430986:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855600, rc 0) 00000100:00100000:1.0:1788666237.431079:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+56:11633:x1875552173647232:12345-192.168.201.25@tcp:101:bash.0 Request processed in 933us (1274us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788666237.431089:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 207 00000100:00100000:3.0:1788666237.440703:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666237.440867:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173647488 00000100:00100000:0.0:1788666237.440884:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173647488 00000100:00100000:0.0:1788666237.440976:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 208 00000100:00100000:0.0:1788666237.440997:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+56:11633:x1875552173647488:12345-192.168.201.25@tcp:36:bash.0 00010000:00010000:0.0:1788666237.441079:0:5809:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788666237.441115:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855600/0x96bbe788361ea7fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42be7 expref: 56 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.441145:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea7e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42be0 expref: 55 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.441160:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:0.0:1788666237.441166:0:5809:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788666237.441935:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea80a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.441963:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea80a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.441978:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea80a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788666237.442055:0:5809:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:0.0:1788666237.442080:0:5809:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000934bcbbd reply state 000000001deec49c transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea80a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666237.442090:0:5809:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788666237.442217:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+57:11633:x1875552173647488:12345-192.168.201.25@tcp:36:bash.0 Request processed in 1227us (1526us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788666237.442226:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 208 00000020:00080000:0.0:1788666237.442232:0:5809:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788666237.445692:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea80a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666237.445717:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea80a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666237.445727:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea80a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666237.445734:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144a600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666237.445740:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea80a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666237.445748:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea80a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666237.445769:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:3.0:1788666237.445772:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666237.445778:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea80a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666237.445806:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea80a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666237.450017:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666237.450293:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173647616 00000100:00100000:0.0:1788666237.450306:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173647616 00000100:00100000:0.0:1788666237.450557:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 209 00000100:00100000:0.0:1788666237.450571:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+56:11633:x1875552173647616:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:0.0:1788666237.450632:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666237.450664:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea811 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42bee expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.450775:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea818 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.450795:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.450849:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666237.450890:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788666237.450895:0:7132:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788666237.450918:0:7132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.450954:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea811 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bee expref: 58 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.450978:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea818 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bee expref: 57 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.450988:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:0.0:1788666237.451002:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788666237.451006:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab28144a800, rc 0) 00000100:00100000:0.0:1788666237.451095:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290579c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+57:11633:x1875552173647616:12345-192.168.201.25@tcp:101:bash.0 Request processed in 526us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666237.451103:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 209 00000100:00100000:1.0:1788666237.460912:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666237.463467:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173647872 00000100:00100000:2.0:1788666237.463498:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173647872 00000100:00100000:2.0:1788666237.463659:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00100000:2.0:1788666237.463672:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+57:11633:x1875552173647872:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:2.0:1788666237.464016:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+58:11633:x1875552173647872:12345-192.168.201.25@tcp:35:bash.0 Request processed in 345us (3116us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788666237.464025:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 59 00000100:00100000:1.0:1788666237.572784:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666237.573049:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173648000 00000100:00100000:2.0:1788666237.573063:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173648000 00000100:00100000:2.0:1788666237.573291:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 210 00000100:00100000:2.0:1788666237.573307:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+58:11639:x1875552173648000:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666237.573367:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666237.573415:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea81f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42bf5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.573516:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea826 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.573531:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.573543:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666237.573621:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788666237.573626:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788666237.573655:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.573686:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea81f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bf5 expref: 60 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.573707:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea826 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bf5 expref: 59 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.573715:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:2.0:1788666237.573718:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788666237.573722:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2e00, rc 0) 00000100:00100000:2.0:1788666237.573782:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae365880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+59:11639:x1875552173648000:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 479us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666237.573790:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 210 00000100:00100000:3.0:1788666237.579015:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666237.591464:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173648128 00000100:00100000:0.0:1788666237.591490:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173648128 00000100:00100000:0.0:1788666237.591627:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 211 00000100:00100000:0.0:1788666237.591649:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+59:11639:x1875552173648128:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788666237.591675:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666237.591703:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea82d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42bfc expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.591818:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea834 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.591946:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea834 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.591963:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea834 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.592023:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f000/0x96bbe788361ea83b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.592033:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f000/0x96bbe788361ea83b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.592041:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f000/0x96bbe788361ea83b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.593010:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361ea842 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.593028:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361ea842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.593037:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361ea842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666237.593087:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788666237.593093:0:5808:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788666237.593118:0:5808:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361ea842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.593146:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361ea842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.593973:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea834 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.593982:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea834 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.593991:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea834 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.593998:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144a600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666237.594003:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea834 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.594012:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea834 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.594027:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:0.0:1788666237.594031:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666237.594036:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea834 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.594042:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a600/0x96bbe788361ea834 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.594058:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f000/0x96bbe788361ea83b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.594064:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f000/0x96bbe788361ea83b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.594081:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f000/0x96bbe788361ea83b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.594087:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2bfa7f000 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666237.594090:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f000/0x96bbe788361ea83b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.594097:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f000/0x96bbe788361ea83b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.594105:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab290a48500) 00010000:00010000:0.0:1788666237.594107:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666237.594110:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f000/0x96bbe788361ea83b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.594115:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f000/0x96bbe788361ea83b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.594354:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144ae00/0x96bbe788361ea82d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bfc expref: 61 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.594374:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361ea842 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bfc expref: 60 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.594383:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:0.0:1788666237.594386:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788666237.594389:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2bfa7e200, rc 0) 00000100:00100000:0.0:1788666237.594497:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+60:11639:x1875552173648128:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 2858us (15496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666237.594516:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 211 00000100:00100000:1.0:1788666237.602740:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666237.603003:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173648384 00000100:00100000:0.0:1788666237.603015:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173648384 00000100:00100000:0.0:1788666237.603083:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 212 00000100:00100000:0.0:1788666237.603096:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+60:11639:x1875552173648384:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788666237.603135:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666237.603302:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361ea849 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42c03 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.603450:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361ea850 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.603469:0:7132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea818 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bee expref: 61 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.603477:0:7132:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361ea842 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bfc expref: 61 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.603484:0:7132:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361ea850 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.603520:0:7132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361ea842 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bfc expref: 61 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.603534:0:7132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361ea842 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bfc expref: 61 pid: 5808 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666237.603548:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186219904:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788666237.603817:0:7132:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea818 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bee expref: 61 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.603827:0:7132:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea818 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bee expref: 61 pid: 7132 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666237.604036:0:7132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186220032:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788666237.604119:0:7132:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2c1b6b480 going to sleep for 11 seconds 00000100:00100000:1.0:1788666237.619648:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00010000:00010000:2.0:1788666237.619958:0:7132:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.25@tcp) returned -22 from blocking AST (req@000000008302624b x1875552186219904) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361ea842 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bfc expref: 61 pid: 5808 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.620008:0:7132:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361ea842 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bfc expref: 61 pid: 5808 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.620038:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361ea842 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bfc expref: 61 pid: 5808 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666237.620055:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9fed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186219904:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788666237.620072:0:7132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7132:1875552186220032:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666237.620095:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:2.0:1788666237.620100:0:7132:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361ea850 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.620109:0:7132:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361ea850 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.620119:0:7132:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361ea850 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666237.620210:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173648512 00000100:00100000:3.0:1788666237.620219:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173648512 00000100:00100000:3.0:1788666237.620305:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:3.0:1788666237.620317:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae364000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+61:2363:x1875552173648512:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666237.620336:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666237.620338:0:5794:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie 96bbe788361ea842) 00010000:00010000:3.0:1788666237.620341:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666237.620430:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae364000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+61:2363:x1875552173648512:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 115us (859us total) trans 0 rc 116/116 00000100:00100000:3.0:1788666237.620438:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:1.0:1788666237.639794:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666237.639914:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173648640 00000100:00100000:0.0:1788666237.639924:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173648640 00010000:00010000:0.0:1788666237.639969:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea818 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bee expref: 61 pid: 7132 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666237.640014:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 78 00000100:00100000:0.0:1788666237.640025:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae726680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+61:2364:x1875552173648640:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788666237.640045:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666237.640052:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea818 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bee expref: 61 pid: 7132 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.640066:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea818 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bee expref: 61 pid: 7132 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.640092:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144a800/0x96bbe788361ea818 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bee expref: 61 pid: 7132 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.640115:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:0.0:1788666237.640121:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361ea850 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.640150:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361ea850 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.640158:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361ea850 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.640204:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666237.640297:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae726680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+60:2364:x1875552173648640:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 272us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666237.640306:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 78 00010000:00010000:1.0:1788666237.640926:0:7132:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361ea850 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666237.640938:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361ea850 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666237.640961:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788666237.641156:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361ea849 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c03 expref: 61 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666237.641178:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361ea850 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c03 expref: 60 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666237.641187:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:1.0:1788666237.641191:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788666237.641194:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2bfa7ec00, rc 0) 00000100:00100000:1.0:1788666237.641262:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae367b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+60:11639:x1875552173648384:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 38169us (38532us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788666237.641270:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 212 00000100:00100000:1.0:1788666237.646054:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666237.646159:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173648896 00000100:00100000:3.0:1788666237.646171:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173648896 00000100:00100000:3.0:1788666237.646257:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:3.0:1788666237.646269:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae726d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+60:11639:x1875552173648896:12345-192.168.201.25@tcp:103:lfs.0 00010000:00010000:3.0:1788666237.646287:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666237.646318:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b800/0x96bbe788361ea7af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bd9 expref: 60 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666237.646339:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:3.0:1788666237.646346:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666237.646433:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae726d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+59:11639:x1875552173648896:12345-192.168.201.25@tcp:103:lfs.0 Request processed in 166us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666237.646460:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:3.0:1788666237.648798:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666237.650861:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173649024 00000100:00100000:2.0:1788666237.650886:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173649024 00000100:00100000:2.0:1788666237.650990:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 213 00000100:00100000:2.0:1788666237.651004:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+59:11639:x1875552173649024:12345-192.168.201.25@tcp:58:lfs.0 00010000:00010000:2.0:1788666237.651132:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea85e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.651172:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea85e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666237.651210:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea85e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788666237.651550:0:12001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788666237.651734:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+59:11639:x1875552173649024:12345-192.168.201.25@tcp:58:lfs.0 Request processed in 731us (2952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666237.651744:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 213 00000100:00100000:1.0:1788666237.654045:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666237.654289:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173649152 00000100:00100000:0.0:1788666237.654301:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173649152 00000100:00100000:0.0:1788666237.654371:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 214 00000100:00100000:0.0:1788666237.654382:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+59:11639:x1875552173649152:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788666237.654408:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666237.654430:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f000/0x96bbe788361ea865 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42c0a expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.654494:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea85e lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.654505:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f000/0x96bbe788361ea865 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c0a expref: 60 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.654523:0:5808:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea85e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.654535:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f000/0x96bbe788361ea865 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c0a expref: 60 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.654568:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:0.0:1788666237.654571:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788666237.654575:0:5808:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f000/0x96bbe788361ea865 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c0a expref: 60 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666237.654613:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2bfa7f000, rc 0) 00000100:00100000:0.0:1788666237.654684:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+60:11639:x1875552173649152:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 304us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666237.654693:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 214 00000004:00080000:3.0:1788666237.838415:0:6676:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 344546831226ns, next at 345546827393ns, rc = 0 00000100:00100000:2.0:1788666237.838503:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186220160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788666237.838619:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666237.838780:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186220160 00000100:00100000:1.0:1788666237.838789:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186220160 00000100:00100000:1.0:1788666237.838847:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788666237.838858:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3275:x1875552186220160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788666237.838901:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666237.838957:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3275:x1875552186220160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666237.838965:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788666237.839067:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa60700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186220160:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788666237.962837:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788666238.027523:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788666238.027533:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788666238.027569:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788666238.027576:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788666238.027747:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9ff100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875552186220288:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788666238.029781:0:11650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2c1b6b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788666238.040262:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9ff100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875552186220288:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788666238.045979:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666238.046088:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173649280 00000100:00100000:1.0:1788666238.046103:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173649280 00000100:00100000:1.0:1788666238.046328:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 215 00000100:00100000:1.0:1788666238.046342:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+60:11640:x1875552173649280:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788666238.046422:0:7132:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788666238.046570:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+60:11640:x1875552173649280:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 231us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666238.046615:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 215 00000100:00080000:2.0:1788666238.048785:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788666238.055815:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666238.059773:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173649408 00000100:00100000:2.0:1788666238.059793:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173649408 00000100:00100000:2.0:1788666238.059916:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 216 00000100:00100000:2.0:1788666238.059929:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+60:11640:x1875552173649408:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788666238.060012:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea86c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060032:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea86c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060046:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea86c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060105:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea873 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060114:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea873 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060146:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea873 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060186:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea87a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060194:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea87a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060202:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea87a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666238.060241:0:12001:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788666238.060246:0:12001:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788666238.060259:0:12001:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea87a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060270:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea86c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060277:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea86c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060285:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea86c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060291:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2c00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666238.060297:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea86c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060304:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea86c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060324:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab2908f2b00) 00010000:00010000:2.0:1788666238.060327:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666238.060333:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea86c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060340:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea86c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060356:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea873 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060362:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea873 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060367:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea873 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060373:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3e00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666238.060376:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea873 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060382:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea873 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060389:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8ab2a088e900) 00010000:00010000:2.0:1788666238.060392:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666238.060394:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea873 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060399:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea873 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060428:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea87a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060434:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea87a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060440:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea87a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060445:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666238.060448:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea87a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060455:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea87a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060462:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:2.0:1788666238.060465:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666238.060467:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea87a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.060473:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea87a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666238.060566:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+60:11640:x1875552173649408:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 Request processed in 638us (4766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666238.060574:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 216 00000100:00100000:3.0:1788666238.068534:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666238.068662:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173649664 00000100:00100000:2.0:1788666238.068677:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173649664 00000100:00100000:2.0:1788666238.068760:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 217 00000100:00100000:2.0:1788666238.068789:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+60:11640:x1875552173649664:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788666238.068822:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666238.068844:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea881 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42c11 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.068960:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea888 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.068977:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.068988:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666238.069001:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788666238.069114:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.069123:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea888 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.069129:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.069136:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3e00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666238.069142:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.069151:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea888 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.069165:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:2.0:1788666238.069317:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788666238.069323:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea888 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.069331:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea888 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.069380:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea881 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c11 expref: 62 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.069391:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab2908f2b00) 00010000:00010000:2.0:1788666238.069394:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788666238.069399:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea881 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c11 expref: 62 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.069408:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f3800, rc 0) 00000100:00100000:2.0:1788666238.069527:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+61:11640:x1875552173649664:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 739us (1006us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1788666238.069536:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 217 00000100:00100000:3.0:1788666238.072498:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666238.076015:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173649792 00000100:00100000:0.0:1788666238.076035:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173649792 00000100:00100000:0.0:1788666238.076113:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 218 00000100:00100000:0.0:1788666238.076122:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+61:11640:x1875552173649792:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788666238.076161:0:5809:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788666238.076445:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+61:11640:x1875552173649792:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 322us (3955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666238.076454:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 218 00000100:00100000:1.0:1788666238.079574:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666238.080355:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173650048 00000100:00100000:2.0:1788666238.080371:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173650048 00000100:00100000:2.0:1788666238.080458:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 219 00000100:00100000:2.0:1788666238.080468:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+61:11640:x1875552173650048:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788666238.080501:0:12001:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666238.080506:0:12001:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788666238.080555:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea826 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42bf5 expref: 61 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.080608:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:2.0:1788666238.080639:0:12001:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788666238.080655:0:12001:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea896 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42c18 expref: -99 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788666238.081394:0:12001:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1788666238.081849:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea89d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.081864:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea89d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.081877:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea89d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.081944:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea896 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c18 expref: 63 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.081963:0:12001:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea89d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c18 expref: 62 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.081971:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab2a088e900) 00010000:00010000:2.0:1788666238.081975:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666238.082129:0:12001:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f3e00, rc 0) 00000100:00100000:2.0:1788666238.082338:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+62:11640:x1875552173650048:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 1869us (2778us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788666238.082347:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 219 00000100:00100000:3.0:1788666238.090083:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666238.093925:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173650304 00000100:00100000:2.0:1788666238.093946:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173650304 00000100:00100000:2.0:1788666238.094136:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 220 00000100:00100000:2.0:1788666238.094148:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+62:11640:x1875552173650304:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788666238.094266:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666238.094305:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3e00/0x96bbe788361ea89d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c18 expref: 62 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.094331:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab2a088e900) 00010000:00010000:2.0:1788666238.094346:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788666238.094379:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea8ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.094396:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea8ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.094407:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea8ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.094466:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea8b2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xda94cbe8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.094475:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea8b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xda94cbe8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.094482:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea8b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xda94cbe8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.094572:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea8ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.094599:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea8ab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.094607:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea8ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.094622:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2e00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666238.094627:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea8ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.094644:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea8ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.094653:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:2.0:1788666238.094656:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666238.094660:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea8ab lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.094667:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2e00/0x96bbe788361ea8ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.094677:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea8b2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xda94cbe8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.094684:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea8b2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xda94cbe8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.094689:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea8b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xda94cbe8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.094694:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2c00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666238.094697:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea8b2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xda94cbe8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.094703:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea8b2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xda94cbe8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.094720:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xda94cbe8 (ffff8ab2a088e600) 00010000:00010000:2.0:1788666238.094722:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666238.094725:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea8b2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xda94cbe8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.094731:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea8b2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xda94cbe8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666238.094849:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+61:11640:x1875552173650304:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 702us (4777us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788666238.094857:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 220 00000100:00100000:3.0:1788666238.099362:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666238.103452:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173650432 00000100:00100000:0.0:1788666238.103473:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173650432 00000100:00100000:0.0:1788666238.103561:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 221 00000100:00100000:0.0:1788666238.103572:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+61:11640:x1875552173650432:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788666238.103609:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666238.103645:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fe00/0x96bbe788361ea8b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42c1f expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.103690:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fc00/0x96bbe788361ea8c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.103707:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fc00/0x96bbe788361ea8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.103721:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fc00/0x96bbe788361ea8c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.103858:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fe00/0x96bbe788361ea8b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c1f expref: 63 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.103879:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fc00/0x96bbe788361ea8c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c1f expref: 62 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.103888:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab290a48500) 00010000:00010000:0.0:1788666238.103891:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788666238.103894:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2bfa7fc00, rc 0) 00000100:00100000:0.0:1788666238.103970:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+62:11640:x1875552173650432:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 401us (4626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666238.103977:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 221 00000100:00100000:1.0:1788666238.113934:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666238.114097:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173650688 00000100:00100000:2.0:1788666238.114108:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173650688 00000100:00100000:2.0:1788666238.114181:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 222 00000100:00100000:2.0:1788666238.114192:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+62:11640:x1875552173650688:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788666238.114333:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea8c7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.114354:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea8c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.114368:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea8c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788666238.114721:0:12001:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:2.0:1788666238.114831:0:12001:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004af93724 reply state 00000000a5383469 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea8c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666238.114843:0:12001:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788666238.114964:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+64:11640:x1875552173650688:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 771us (1040us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788666238.114972:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 222 00000100:00100000:0.0:1788666238.122624:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666238.124509:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173650816 00000100:00100000:2.0:1788666238.124527:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173650816 00000100:00100000:2.0:1788666238.124694:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 223 00000100:00100000:2.0:1788666238.124707:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+64:11640:x1875552173650816:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788666238.124752:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666238.124779:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea8ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42c26 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.124856:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea8ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c26 expref: 65 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.124884:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea8ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c26 expref: 65 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.124908:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab290a48500) 00010000:00010000:2.0:1788666238.124912:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788666238.124916:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2c00, rc 0) 00000100:00100000:2.0:1788666238.125022:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+65:11640:x1875552173650816:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 317us (2410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666238.125030:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 223 00010000:00010000:1.0:1788666238.133786:0:3261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea8c7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.133816:0:3261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea8c7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.133825:0:3261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea8c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.133832:0:3261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666238.133839:0:3261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea8c7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.133848:0:3261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea8c7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.133876:0:3261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab290a48500) 00010000:00010000:1.0:1788666238.133880:0:3261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788666238.133887:0:3261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea8c7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.133894:0:3261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea8c7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666238.135234:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666238.135464:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173650944 00000100:00100000:1.0:1788666238.135476:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173650944 00000100:00100000:1.0:1788666238.135559:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:1.0:1788666238.135570:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+9:2363:x1875552173650944:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788666238.136073:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788666238.136292:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+10:2363:x1875552173650944:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 718us (1064us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788666238.136303:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:0.0:1788666238.147957:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666238.148082:0:11980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173651200 00000100:00100000:3.0:1788666238.148092:0:11980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173651200 00000100:00100000:3.0:1788666238.148137:0:11980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:3.0:1788666238.148147:0:11980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+64:11640:x1875552173651200:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788666238.148441:0:11980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+65:11640:x1875552173651200:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 295us (496us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1788666238.148450:0:11980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 60 00000100:00100000:0.0:1788666238.158886:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666238.160453:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173651456 00000100:00100000:1.0:1788666238.160473:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173651456 00000100:00100000:1.0:1788666238.160557:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 224 00000100:00100000:1.0:1788666238.160568:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+65:11640:x1875552173651456:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788666238.160769:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+65:11640:x1875552173651456:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 191us (1888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666238.160778:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 224 00000100:00100000:0.0:1788666238.163152:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666238.163294:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173651584 00000100:00100000:3.0:1788666238.163306:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173651584 00000100:00100000:3.0:1788666238.163370:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 225 00000100:00100000:3.0:1788666238.163380:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+65:11640:x1875552173651584:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788666238.163400:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666238.163422:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8400/0x96bbe788361ea8d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42c2d expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.163544:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9600/0x96bbe788361ea8dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.163573:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9600/0x96bbe788361ea8dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.163616:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9600/0x96bbe788361ea8dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666238.163663:0:7132:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788666238.163682:0:7132:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9600/0x96bbe788361ea8dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.163709:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8400/0x96bbe788361ea8d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c2d expref: 67 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.163727:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9600/0x96bbe788361ea8dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c2d expref: 66 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.163737:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab290a48500) 00010000:00010000:3.0:1788666238.163740:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788666238.163744:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e9600, rc 0) 00000100:00100000:3.0:1788666238.163803:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+66:11640:x1875552173651584:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 424us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666238.163809:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 225 00000100:00100000:0.0:1788666238.177368:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666238.178732:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173651712 00000100:00100000:2.0:1788666238.178750:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173651712 00000100:00100000:2.0:1788666238.178902:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:2.0:1788666238.178915:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+10:2364:x1875552173651712:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788666238.178956:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666238.178996:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361ea8e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42c34 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788666238.179028:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ce17e, blocks: 0x1 00010000:00010000:2.0:1788666238.179051:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=344s v=(0 0) 00010000:00010000:2.0:1788666238.179057:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666238.179068:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361ea8e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c34 expref: 11 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.179087:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361ea8e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c34 expref: 11 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.179101:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2e00, rc 0) 00000100:00100000:2.0:1788666238.180752:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+11:2364:x1875552173651712:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 1824us (3383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666238.180767:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:1.0:1788666238.187007:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666238.187093:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173651968 00000100:00100000:3.0:1788666238.187104:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173651968 00000100:00100000:3.0:1788666238.187180:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 226 00000100:00100000:3.0:1788666238.187192:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+66:11640:x1875552173651968:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788666238.187383:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+66:11640:x1875552173651968:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 193us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666238.187405:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 226 00000100:00100000:0.0:1788666238.190948:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666238.191061:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173652096 00000100:00100000:3.0:1788666238.191076:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173652096 00000100:00100000:3.0:1788666238.191163:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 65 00000100:00100000:3.0:1788666238.191188:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+11:11640:x1875552173652096:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788666238.191219:0:6651:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666238.191256:0:6651:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e7118d9/0x96bbe788361ea8ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42c3b expref: -99 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.191314:0:6651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361ea8e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c34 expref: 12 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.191326:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666238.191331:0:6651:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666238.191337:0:6651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e7118d9/0x96bbe788361ea8ea lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c3b expref: 12 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.191392:0:6651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361ea8e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c34 expref: 12 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.191408:0:6651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361ea8e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c34 expref: 12 pid: 8429 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666238.191429:0:6651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bc3f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6651:1875552186220416:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788666238.191667:0:6651:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788666238.198043:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666238.198167:0:6651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bc3f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6651:1875552186220416:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788666238.198217:0:6651:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004e7118d9/0x96bbe788361ea8ea lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c3b expref: 12 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.198245:0:6651:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e8400, rc 0) 00000100:00100000:3.0:1788666238.198327:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+12:11640:x1875552173652096:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 7153us (7394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666238.198337:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 65 00000100:00100000:2.0:1788666238.202444:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173652224 00000100:00100000:2.0:1788666238.202471:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173652224 00010000:00010000:0.0:1788666238.202709:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361ea8e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c34 expref: 12 pid: 8429 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666238.202777:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:0.0:1788666238.202791:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a096d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+12:2363:x1875552173652224:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788666238.202815:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666238.202848:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361ea8e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c34 expref: 12 pid: 8429 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.202863:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361ea8e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c34 expref: 12 pid: 8429 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.202896:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361ea8e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c34 expref: 12 pid: 8429 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.202920:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788666238.202925:0:5793:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788666238.202956:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004e7118d9/0x96bbe788361ea8ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c3b expref: 11 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.202968:0:5793:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e7118d9/0x96bbe788361ea8ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c3b expref: 11 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.203131:0:5793:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004e7118d9/0x96bbe788361ea8ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c3b expref: 11 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666238.203151:0:5793:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9fc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5793:1875552186220544:192.168.201.25@tcp:105: 00000100:00100000:0.0:1788666238.203339:0:5793:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2c1b6bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788666238.217849:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666238.218122:0:5793:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9fc380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5793:1875552186220544:192.168.201.25@tcp:105: 00010000:00010000:3.0:1788666238.218158:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666238.218226:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a096d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+11:2363:x1875552173652224:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 15438us (20194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666238.218240:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:1.0:1788666238.218355:0:6655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173652352 00000100:00100000:1.0:1788666238.218367:0:6655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173652352 00002000:00100000:1.0:1788666238.218425:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8ab2bf9ff480 x1875552173652352/t0(0) o4->0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp:279/0 lens 504/0 e 0 to 0 dl 1788666249 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788666238.218437:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab2bf9ff480 with x1875552173652352 ext(0->12) 00002000:00010000:1.0:1788666238.218443:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab2bf9ff480 00000100:00100000:1.0:1788666238.218478:0:6655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:1.0:1788666238.218487:0:6655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0911d461-5865-4ef7-8c3e-012fc04add58+11:2364:x1875552173652352:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788666238.221849:0:6655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0911d461-5865-4ef7-8c3e-012fc04add58+13:2364:x1875552173652352:12345-192.168.201.25@tcp:4:lhsmtool_posix.0 Request processed in 3342us (3996us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788666238.221869:0:6655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00002000:00100000:3.0:1788666238.221885:0:6655:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8ab2bf9ff480 x1875552173652352/t4294967320(0) o4->0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp:279/0 lens 504/448 e 0 to 0 dl 1788666249 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788666238.221897:0:6655:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab2bf9ff480 with x1875552173652352 ext(0->12) 00002000:00010000:3.0:1788666238.221907:0:6655:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab2bf9ff480 00000100:00100000:0.0:1788666238.235098:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666238.238736:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173652480 00000100:00100000:3.0:1788666238.238763:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173652480 00000100:00100000:3.0:1788666238.238892:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 227 00000100:00100000:3.0:1788666238.238906:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+66:11640:x1875552173652480:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788666238.341433:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967500 is committed 00000001:00080000:2.0:1788666238.341466:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000020:00080000:2.0:1788666238.341499:0:5830:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab2814150c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1788666238.341504:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab2a0cf4000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab2a1c90d80 00000020:00080000:2.0:1788666238.341508:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab2a0cf4700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab29048a400 00000001:00080000:2.0:1788666238.341539:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:2.0:1788666238.341555:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788666238.341601:0:5830:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab181165e40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1788666238.341604:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab2904d4d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab181165600 00000020:00080000:2.0:1788666238.341607:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab2904d4000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab2bc3e2c00 00000004:00080000:2.0:1788666238.341618:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1788666238.341635:0:5830:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1788666238.341642:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1788666238.341648:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000100:00100000:3.0:1788666238.341960:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+20:11640:x1875552173652480:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 Request processed in 103051us (106875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666238.341988:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 227 00000020:00080000:0.0:1788666238.342820:0:5841:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788666238.343057:0:5841:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788666238.343212:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788666238.343301:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788666238.343323:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186220800:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788666238.343396:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666238.343471:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186220800 00000100:00100000:0.0:1788666238.343479:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186220800 00000100:00100000:0.0:1788666238.343543:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788666238.343554:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3278:x1875552186220800:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788666238.343636:0:6649:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1788666238.343681:0:6649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009deedfa7/0x96bbe788361ea8f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.343714:0:6649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fb206275/0x96bbe788361ea6b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b9a expref: 12 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.343745:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1788666238.343752:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788666238.343759:0:6649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009deedfa7/0x96bbe788361ea8f1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.343798:0:6649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fb206275/0x96bbe788361ea6b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b9a expref: 12 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.343817:0:6649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fb206275/0x96bbe788361ea6b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b9a expref: 12 pid: 6651 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666238.343834:0:6649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab18253f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6649:1875552186220928:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788666238.343912:0:6649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29885fcc0 going to sleep for 11 seconds 00000100:00080000:0.0:1788666238.343927:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788666238.345363:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666238.345441:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bf9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186220672:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788666238.345491:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666238.345803:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173652608 00000100:00100000:1.0:1788666238.345827:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173652608 00000100:00100000:1.0:1788666238.345895:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186220672 00000100:00100000:1.0:1788666238.345898:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186220672 00000100:00100000:1.0:1788666238.345941:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 67 00000100:00100000:1.0:1788666238.345953:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+13:2362:x1875552173652608:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 00000100:00080000:3.0:1788666238.346184:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788666238.351986:0:6649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab18253f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6649:1875552186220928:192.168.201.25@tcp:104: 00010000:00010000:1.0:1788666238.352026:0:6649:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009deedfa7/0x96bbe788361ea8f1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666238.354660:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666238.354708:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173652736 00000100:00100000:3.0:1788666238.354722:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173652736 00010000:00010000:3.0:1788666238.354777:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fb206275/0x96bbe788361ea6b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b9a expref: 14 pid: 6651 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666238.354820:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 80 00000100:00100000:3.0:1788666238.354831:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae278e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+14:2364:x1875552173652736:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666238.354847:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666238.354853:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fb206275/0x96bbe788361ea6b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b9a expref: 14 pid: 6651 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.354866:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fb206275/0x96bbe788361ea6b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b9a expref: 14 pid: 6651 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.354896:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb206275/0x96bbe788361ea6b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b9a expref: 14 pid: 6651 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.354921:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788666238.354941:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788666238.354949:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009deedfa7/0x96bbe788361ea8f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.354960:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009deedfa7/0x96bbe788361ea8f1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.354997:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666238.355046:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae278e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0911d461-5865-4ef7-8c3e-012fc04add58+13:2364:x1875552173652736:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 216us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666238.355054:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 80 00010000:00010000:3.0:1788666238.355149:0:6649:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009deedfa7/0x96bbe788361ea8f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.355160:0:6649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009deedfa7/0x96bbe788361ea8f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.355180:0:6649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009deedfa7/0x96bbe788361ea8f1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.355188:0:6649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009deedfa7/0x96bbe788361ea8f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.355203:0:6649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788666238.355853:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3278:x1875552186220800:12345-0@lo:6:osp-syn-0-0.0 Request processed in 12296us (12452us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1788666238.355863:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788666238.355893:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788666238.355902:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bc3f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3275:x1875552186220672:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788666238.355931:0:6649:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1788666238.355966:0:6649:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9ce17d, atime: 0x6a9ce17d, ctime: 0x6a9ce17d, blocks: 0x1 00010000:00010000:3.0:1788666238.355974:0:6649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddb1bf24/0x96bbe788361ea8f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.355985:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1788666238.355989:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666238.355993:0:6649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ddb1bf24/0x96bbe788361ea8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.356006:0:6649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ddb1bf24/0x96bbe788361ea8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.356015:0:6649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ddb1bf24/0x96bbe788361ea8f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.356022:0:6649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ddb1bf24/0x96bbe788361ea8f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.356038:0:6649:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00000100:00100000:3.0:1788666238.356441:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3275:x1875552186220672:12345-0@lo:6:osp-syn-1-0.0 Request processed in 541us (10948us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788666238.356448:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:3.0:1788666238.356474:0:7594:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788666238.356481:0:7594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009deedfa7/0x96bbe788361ea8f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.356496:0:7594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2bfa7e000 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666238.356501:0:7594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009deedfa7/0x96bbe788361ea8f1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.356511:0:7594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009deedfa7/0x96bbe788361ea8f1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.356528:0:7594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009deedfa7/0x96bbe788361ea8f1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.356535:0:7594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009deedfa7/0x96bbe788361ea8f1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.356556:0:7594:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666238.356559:0:7594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ddb1bf24/0x96bbe788361ea8f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.356565:0:7594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e8e00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666238.356568:0:7594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddb1bf24/0x96bbe788361ea8f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.356576:0:7594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ddb1bf24/0x96bbe788361ea8f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.356616:0:7594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ddb1bf24/0x96bbe788361ea8f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.356640:0:7594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ddb1bf24/0x96bbe788361ea8f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.356657:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666238.356658:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666238.356660:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666238.356668:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788666238.356712:0:3275:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab2bf9fdc00/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788666238.356719:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186220672:0@lo:6:osp-syn-1-0.0 00000004:00080000:3.0:1788666238.356754:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab2bf9fc380/2, rc 0, transno 4294967321 00000100:00100000:3.0:1788666238.356768:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bf9fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186220800:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1788666238.386305:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:3.0:1788666238.386325:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:3.0:1788666238.386331:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:2.0:1788666238.386506:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bc3f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+7:2362:x1875552173652608:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 Request processed in 40547us (41141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666238.386518:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 67 00000100:00100000:3.0:1788666238.391011:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666238.391147:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173652992 00000100:00100000:0.0:1788666238.391165:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173652992 00000100:00100000:0.0:1788666238.391256:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 228 00000100:00100000:0.0:1788666238.391271:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2988fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+20:11640:x1875552173652992:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788666238.391365:0:5808:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666238.391405:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9600/0x96bbe788361ea8dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c2d expref: 20 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.391431:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab290a48500) 00010000:00010000:0.0:1788666238.391437:0:5808:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788666238.391508:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e000/0x96bbe788361ea8ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.391526:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e000/0x96bbe788361ea8ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.391539:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e000/0x96bbe788361ea8ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788666238.392375:0:5808:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007f3a2ff5 reply state 00000000ecc2d842 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e000/0x96bbe788361ea8ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666238.392396:0:5808:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788666238.392570:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2988fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+21:11640:x1875552173652992:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 1298us (1568us total) trans 4294967507 rc 0/0 00000100:00100000:0.0:1788666238.392614:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 228 00010000:00010000:0.0:1788666238.395199:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e000/0x96bbe788361ea8ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.395234:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e000/0x96bbe788361ea8ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.395245:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e000/0x96bbe788361ea8ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.395253:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2bfa7e000 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666238.395263:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e000/0x96bbe788361ea8ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.395275:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e000/0x96bbe788361ea8ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.395302:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab290a48500) 00010000:00010000:0.0:1788666238.395331:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666238.395339:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e000/0x96bbe788361ea8ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.395346:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e000/0x96bbe788361ea8ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666238.395778:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666238.395939:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173653120 00000100:00100000:0.0:1788666238.395952:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173653120 00000100:00100000:0.0:1788666238.396073:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:0.0:1788666238.396085:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae364000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173653120:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788666238.396382:0:8429:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788666238.396387:0:8429:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788666237 00002000:00010000:0.0:1788666238.396389:0:8429:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788666237 00002000:00010000:0.0:1788666238.396392:0:8429:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788666238 -> 1788666237 00002000:00010000:0.0:1788666238.396394:0:8429:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788666238.396471:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae364000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+8:2363:x1875552173653120:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 389us (701us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788666238.396479:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:3.0:1788666238.399246:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666238.399427:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173653376 00000100:00100000:1.0:1788666238.399446:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173653376 00000100:00100000:1.0:1788666238.399571:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 229 00000100:00100000:1.0:1788666238.399636:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+20:11640:x1875552173653376:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788666238.399749:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea906 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.399772:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fc00/0x96bbe788361ea8c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c1f expref: 20 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.399784:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea906 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.399838:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fc00/0x96bbe788361ea8c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c1f expref: 20 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.399855:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fc00/0x96bbe788361ea8c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c1f expref: 20 pid: 5808 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666238.399896:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875552186221056:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788666238.400010:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab182357a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788666238.406744:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666238.406770:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875552186221056:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788666238.406805:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea906 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666238.406997:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173653504 00000100:00100000:3.0:1788666238.407008:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173653504 00010000:00010000:3.0:1788666238.407060:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fc00/0x96bbe788361ea8c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c1f expref: 21 pid: 5808 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666238.407148:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 81 00000100:00100000:3.0:1788666238.407159:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+21:2363:x1875552173653504:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666238.407180:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666238.407205:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fc00/0x96bbe788361ea8c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c1f expref: 21 pid: 5808 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.407218:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fc00/0x96bbe788361ea8c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c1f expref: 21 pid: 5808 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.407245:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fc00/0x96bbe788361ea8c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c1f expref: 21 pid: 5808 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.407264:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab290a48500) 00010000:00010000:3.0:1788666238.407270:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea906 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.407283:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea906 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.407291:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea906 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.407325:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666238.407402:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+20:2363:x1875552173653504:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 244us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666238.407411:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 81 00010000:00010000:1.0:1788666238.407664:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea906 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.407672:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea906 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.407713:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea906 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.407721:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea906 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.407728:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea906 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.407735:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666238.407740:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea906 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.407748:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea906 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.407759:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab290a48500) 00010000:00010000:1.0:1788666238.407762:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788666238.407766:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea906 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.407786:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea906 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666238.407850:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+19:11640:x1875552173653376:12345-192.168.201.25@tcp:55:lhsmtool_posix.0 Request processed in 8270us (8618us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788666238.407858:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 229 00000100:00100000:1.0:1788666238.414911:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666238.415023:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173653632 00000100:00100000:3.0:1788666238.415040:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173653632 00000100:00100000:3.0:1788666238.415126:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 70 00000100:00100000:3.0:1788666238.415138:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+8:2363:x1875552173653632:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788666238.415217:0:6649:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ddb1bf24/0x96bbe788361ea90d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.415272:0:6649:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004e7118d9/0x96bbe788361ea8ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c3b expref: 8 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.415281:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788666238.415287:0:6649:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788666238.415294:0:6649:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddb1bf24/0x96bbe788361ea90d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.415349:0:6649:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004e7118d9/0x96bbe788361ea8ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c3b expref: 8 pid: 6651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.415366:0:6649:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004e7118d9/0x96bbe788361ea8ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c3b expref: 8 pid: 6651 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666238.415385:0:6649:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae726d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6649:1875552186221184:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788666238.415480:0:6649:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28673f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666238.421945:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666238.422119:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173653760 00000100:00100000:0.0:1788666238.422131:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173653760 00010000:00010000:0.0:1788666238.422184:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004e7118d9/0x96bbe788361ea8ea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c3b expref: 9 pid: 6651 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666238.422245:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 82 00000100:00100000:0.0:1788666238.422278:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+9:2364:x1875552173653760:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788666238.422298:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666238.422783:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004e7118d9/0x96bbe788361ea8ea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c3b expref: 9 pid: 6651 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.422801:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004e7118d9/0x96bbe788361ea8ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c3b expref: 9 pid: 6651 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.422842:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788666238.422848:0:5794:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788666238.422858:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ddb1bf24/0x96bbe788361ea90d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.422871:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ddb1bf24/0x96bbe788361ea90d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.422905:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666238.422991:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+9:2364:x1875552173653760:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 715us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666238.423000:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 82 00010000:00010000:3.0:1788666238.424031:0:6649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e7118d9/0x96bbe788361ea8ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c3b expref: 8 pid: 6651 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666238.424054:0:6649:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae726d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6649:1875552186221184:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788666238.424083:0:6649:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ddb1bf24/0x96bbe788361ea90d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.424094:0:6649:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ddb1bf24/0x96bbe788361ea90d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.424120:0:6649:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ddb1bf24/0x96bbe788361ea90d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.424153:0:6649:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ddb1bf24/0x96bbe788361ea90d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.424162:0:6649:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ddb1bf24/0x96bbe788361ea90d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.424170:0:6649:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ddb1bf24/0x96bbe788361ea90d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.424177:0:6649:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e8e00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666238.424182:0:6649:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddb1bf24/0x96bbe788361ea90d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.424191:0:6649:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ddb1bf24/0x96bbe788361ea90d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.424209:0:6649:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ddb1bf24/0x96bbe788361ea90d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.424217:0:6649:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ddb1bf24/0x96bbe788361ea90d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6649 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666238.424325:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173653632:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 Request processed in 9189us (9432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666238.424335:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 70 00000100:00100000:2.0:1788666238.427775:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666238.427913:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173654016 00000100:00100000:3.0:1788666238.427930:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173654016 00000100:00100000:3.0:1788666238.428031:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 230 00000100:00100000:3.0:1788666238.428047:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+19:11640:x1875552173654016:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788666238.428187:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8a00/0x96bbe788361ea914 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.428212:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8a00/0x96bbe788361ea914 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.428229:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8a00/0x96bbe788361ea914 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.428644:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea91b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.428656:0:12001:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea8ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c26 expref: 20 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.428665:0:12001:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea91b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.428715:0:12001:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea8ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c26 expref: 20 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.428747:0:12001:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea8ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c26 expref: 20 pid: 5808 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666238.428763:0:12001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae726d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12001:1875552186221312:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788666238.429120:0:12001:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28673f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788666238.433244:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666238.433367:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173654144 00000100:00100000:1.0:1788666238.433393:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173654144 00010000:00010000:1.0:1788666238.433459:0:5793:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea8ce lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c26 expref: 21 pid: 5808 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666238.433559:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 83 00000100:00100000:1.0:1788666238.433571:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+21:2364:x1875552173654144:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666238.434197:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666238.434213:0:5793:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea8ce lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c26 expref: 21 pid: 5808 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.434232:0:5793:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea8ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c26 expref: 21 pid: 5808 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.434262:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab290a48500) 00010000:00010000:1.0:1788666238.434270:0:5793:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea91b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.434281:0:5793:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea91b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.434313:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea91b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.434337:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666238.434418:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+21:2364:x1875552173654144:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 847us (1193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666238.434429:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 83 00010000:00010000:3.0:1788666238.434804:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2c00/0x96bbe788361ea8ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c26 expref: 20 pid: 5808 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666238.434822:0:12001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae726d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12001:1875552186221312:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788666238.434850:0:12001:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea91b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.434860:0:12001:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea91b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.434866:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea91b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788666238.436133:0:12001:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1788666238.436336:0:12001:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1788666238.436406:0:12001:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1788666238.436532:0:12001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae726d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12001:1875552186221440:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788666238.438296:0:12001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666238.438386:0:12001:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a15169c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666238.438440:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186221440 00000100:00100000:1.0:1788666238.438455:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186221440 00000100:00100000:1.0:1788666238.438700:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788666238.438713:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12001:x1875552186221440:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788666238.438831:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:12001:x1875552186221440:12345-0@lo:1000:mdt00_004.0 Request processed in 121us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666238.438839:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788666238.438912:0:12001:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:3.0:1788666238.438920:0:12001:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:3.0:1788666238.438954:0:12001:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8ab2bf9fc380 x1875552186220800/t4294967321(4294967321) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788666254 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666238.439003:0:12001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae726d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12001:1875552186221440:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1788666238.439644:0:12001:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1788666238.439759:0:12001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2905ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12001:1875552186221568:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788666238.439821:0:12001:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666238.441191:0:12001:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab1811653c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788666238.441350:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186221568 00000100:00100000:0.0:1788666238.441364:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186221568 00000100:00100000:0.0:1788666238.441428:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788666238.441439:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:12001:x1875552186221568:12345-0@lo:1000:mdt00_004.0 00000100:00100000:0.0:1788666238.442181:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:12001:x1875552186221568:12345-0@lo:1000:mdt00_004.0 Request processed in 742us (2357us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788666238.442208:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788666238.442363:0:12001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2905ec700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:12001:1875552186221568:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1788666238.442428:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea91b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.442443:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea91b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.442452:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea91b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.442458:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e8200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666238.442466:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea91b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.442475:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea91b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.442496:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab290a48500) 00010000:00010000:3.0:1788666238.442499:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788666238.442504:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea91b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.442511:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8200/0x96bbe788361ea91b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.442728:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea85e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.442734:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea85e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.442741:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea85e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.442746:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666238.442749:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea85e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.442755:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea85e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.442764:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:3.0:1788666238.442767:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788666238.442774:0:12001:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f000/0x96bbe788361ea865 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c0a expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.442787:0:12001:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f000/0x96bbe788361ea865 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c0a expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.442797:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f000/0x96bbe788361ea865 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c0a expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.442926:0:12001:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f000/0x96bbe788361ea865 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c0a expref: 23 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666238.442943:0:12001:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab18253f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12001:1875552186221696:192.168.201.25@tcp:105: 00000100:00100000:0.0:1788666238.443227:0:12001:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29885f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788666238.447868:0:12001:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab18253f100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12001:1875552186221696:192.168.201.25@tcp:105: 00010000:00010000:1.0:1788666238.447911:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea85e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.447924:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea85e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.447964:0:12001:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea922 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.447992:0:12001:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea922 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.448005:0:12001:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea922 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.448030:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea922 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.448037:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea922 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.448044:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea922 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.448050:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666238.448054:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea922 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.448061:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea922 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.448073:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:1.0:1788666238.448076:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666238.448080:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea922 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.448085:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855200/0x96bbe788361ea922 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.448094:0:12001:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8a00/0x96bbe788361ea914 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.448100:0:12001:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8a00/0x96bbe788361ea914 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.448106:0:12001:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8a00/0x96bbe788361ea914 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.448114:0:12001:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e8a00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666238.448117:0:12001:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8a00/0x96bbe788361ea914 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.448123:0:12001:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8a00/0x96bbe788361ea914 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.448130:0:12001:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:1.0:1788666238.448132:0:12001:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788666238.448135:0:12001:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8a00/0x96bbe788361ea914 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666238.448140:0:12001:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8a00/0x96bbe788361ea914 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12001 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666238.448426:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+23:11640:x1875552173654016:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 20383us (20665us total) trans 4294967512 rc 0/0 00000100:00100000:1.0:1788666238.448437:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 230 00000020:00080000:1.0:1788666238.448444:0:12001:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788666238.448680:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666238.448785:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173654272 00000100:00100000:1.0:1788666238.448792:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173654272 00000100:00100000:1.0:1788666238.448836:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 61 00000100:00100000:1.0:1788666238.448844:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+23:11639:x1875552173654272:12345-192.168.201.25@tcp:49:lfs.0 00000100:00100000:1.0:1788666238.448952:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+23:11639:x1875552173654272:12345-192.168.201.25@tcp:49:lfs.0 Request processed in 108us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666238.448958:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 61 00000040:00080000:3.0:1788666238.449812:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788666238.449821:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788666238.450438:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788666238.450450:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788666238.454364:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666238.457839:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173654528 00000100:00100000:2.0:1788666238.457860:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173654528 00000100:00100000:2.0:1788666238.457940:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 62 00000100:00100000:2.0:1788666238.457954:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28f364450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+23:11640:x1875552173654528:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788666238.459169:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000004:00080000:2.0:1788666238.459738:0:5812:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788666238.459854:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1788666238.459921:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea929 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.459941:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea929 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.459953:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea929 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.459962:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea929 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.459990:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea929 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.459997:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea929 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.460024:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788666238.460204:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28f364450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+25:11640:x1875552173654528:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 2252us (5851us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788666238.460215:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 62 00000020:00080000:2.0:1788666238.460221:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788666238.460480:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666238.460489:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea929 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.460497:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2800 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666238.460503:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea929 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.460523:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea929 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.460537:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8ab2a088ef00) 00010000:00010000:3.0:1788666238.460540:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788666238.460545:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea929 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.460551:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2800/0x96bbe788361ea929 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666238.460571:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666238.460573:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666238.460575:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666238.462757:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173654784 00000100:00100000:0.0:1788666238.462778:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173654784 00000100:00100000:0.0:1788666238.462860:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 231 00000100:00100000:0.0:1788666238.462870:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+25:11639:x1875552173654784:12345-192.168.201.25@tcp:58:lfs.0 00000040:00080000:0.0:1788666238.463248:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788666238.463394:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+25:11639:x1875552173654784:12345-192.168.201.25@tcp:58:lfs.0 Request processed in 524us (4229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666238.463403:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 231 00000100:00100000:1.0:1788666238.495270:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666238.495404:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173654912 00000100:00100000:0.0:1788666238.495417:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173654912 00000100:00100000:0.0:1788666238.495488:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 232 00000100:00100000:0.0:1788666238.495498:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+25:11643:x1875552173654912:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788666238.495537:0:5809:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666238.495559:0:5809:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e800/0x96bbe788361ea930 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42c42 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.495682:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fe00/0x96bbe788361ea937 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.495699:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fe00/0x96bbe788361ea937 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.495726:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fe00/0x96bbe788361ea937 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.495742:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361ea93e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.495750:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361ea93e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.495758:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361ea93e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.496011:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ea00/0x96bbe788361ea945 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.496023:0:5809:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361ea850 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c03 expref: 26 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.496032:0:5809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ea00/0x96bbe788361ea945 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.496073:0:5809:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361ea850 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c03 expref: 26 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.496089:0:5809:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361ea850 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c03 expref: 26 pid: 7132 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666238.496105:0:5809:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab18253f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875552186221824:192.168.201.25@tcp:104: 00000100:00100000:0.0:1788666238.496206:0:5809:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29885fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666238.499560:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666238.499714:0:11980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173655168 00000100:00100000:3.0:1788666238.499727:0:11980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173655168 00000100:00100000:3.0:1788666238.499798:0:11980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:3.0:1788666238.499811:0:11980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+27:5600:x1875552173655168:12345-192.168.201.25@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788666238.500087:0:11980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae842300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+28:5600:x1875552173655168:12345-192.168.201.25@tcp:35:ldlm_bl.0 Request processed in 278us (541us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1788666238.500094:0:11980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 63 00000100:00100000:0.0:1788666238.500538:0:5809:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab18253f800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5809:1875552186221824:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788666238.500575:0:5809:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ea00/0x96bbe788361ea945 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666238.505718:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666238.505797:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173655296 00000100:00100000:0.0:1788666238.505812:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173655296 00010000:00010000:0.0:1788666238.505875:0:5794:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361ea850 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c03 expref: 28 pid: 7132 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666238.505932:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 84 00000100:00100000:0.0:1788666238.505942:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+28:2364:x1875552173655296:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788666238.505960:0:5794:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666238.505967:0:5794:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361ea850 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c03 expref: 28 pid: 7132 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.505991:0:5794:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361ea850 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c03 expref: 28 pid: 7132 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.506018:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361ea850 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c03 expref: 28 pid: 7132 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.506037:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:0.0:1788666238.506044:0:5794:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ea00/0x96bbe788361ea945 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.506055:0:5794:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ea00/0x96bbe788361ea945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.506064:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ea00/0x96bbe788361ea945 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666238.506126:0:5794:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666238.506194:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b96d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0911d461-5865-4ef7-8c3e-012fc04add58+27:2364:x1875552173655296:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 253us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666238.506203:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 84 00010000:00010000:2.0:1788666238.506281:0:5809:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ea00/0x96bbe788361ea945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.506290:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ea00/0x96bbe788361ea945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666238.506344:0:5809:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788666238.506349:0:5809:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788666238.506371:0:5809:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ea00/0x96bbe788361ea945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.506397:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ea00/0x96bbe788361ea945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.506406:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fe00/0x96bbe788361ea937 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.506413:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fe00/0x96bbe788361ea937 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.506432:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fe00/0x96bbe788361ea937 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.506438:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2bfa7fe00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666238.506443:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fe00/0x96bbe788361ea937 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.506452:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fe00/0x96bbe788361ea937 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.506463:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:2.0:1788666238.506466:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666238.506470:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fe00/0x96bbe788361ea937 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.506476:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fe00/0x96bbe788361ea937 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.506487:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361ea93e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.506494:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361ea93e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.506499:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361ea93e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.506504:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2bfa7ee00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666238.506507:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361ea93e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.506526:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361ea93e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.506535:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8ab290a48100) 00010000:00010000:2.0:1788666238.506537:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666238.506540:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361ea93e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.506546:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361ea93e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.506667:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e800/0x96bbe788361ea930 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c42 expref: 27 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.506682:0:5809:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ea00/0x96bbe788361ea945 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c42 expref: 26 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666238.506688:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:2.0:1788666238.506690:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666238.506693:0:5809:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2bfa7ea00, rc 0) 00000100:00100000:2.0:1788666238.506730:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+26:11643:x1875552173654912:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 11235us (11474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666238.506738:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 232 00010000:00010000:2.0:1788666238.988812:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788666239.498868:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788666239.498880:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788666239.498920:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788666239.498927:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788666239.499084:0:11650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2905ef480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875552186221952:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788666239.499355:0:11650:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2b4a2a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788666239.508731:0:11650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2905ef480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11650:1875552186221952:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788666239.517897:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666239.518102:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173655424 00000100:00100000:2.0:1788666239.518115:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173655424 00000100:00100000:2.0:1788666239.518190:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 233 00000100:00100000:2.0:1788666239.518202:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+26:11654:x1875552173655424:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788666239.518265:0:12001:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788666239.518394:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+26:11654:x1875552173655424:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 194us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666239.518403:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 233 00000100:00100000:2.0:1788666239.532886:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666239.532973:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173655680 00000100:00100000:0.0:1788666239.532984:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173655680 00000100:00100000:0.0:1788666239.533047:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 234 00000100:00100000:0.0:1788666239.533058:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+26:11654:x1875552173655680:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788666239.533081:0:7132:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666239.533104:0:7132:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361ea94c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42c49 expref: -99 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666239.533237:0:7132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361ea953 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666239.533255:0:7132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361ea953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666239.533271:0:7132:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361ea953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7132 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666239.533284:0:7132:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788666239.533460:0:7132:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361ea94c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c49 expref: 29 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666239.533479:0:7132:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361ea953 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c49 expref: 28 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666239.533501:0:7132:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:0.0:1788666239.533504:0:7132:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788666239.533508:0:7132:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2bfa7f600, rc 0) 00000100:00100000:0.0:1788666239.533639:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+28:11654:x1875552173655680:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 582us (762us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788666239.533647:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 234 00000100:00100000:0.0:1788666239.538030:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666239.538173:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173656064 00000100:00100000:3.0:1788666239.538187:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173656064 00000100:00100000:3.0:1788666239.538286:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:3.0:1788666239.538300:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab18253f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+28:2361:x1875552173656064:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666239.538317:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666239.538345:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361ea953 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c49 expref: 28 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666239.538366:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:3.0:1788666239.538372:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666239.538445:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab18253f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0911d461-5865-4ef7-8c3e-012fc04add58+27:2361:x1875552173656064:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 148us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666239.538454:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:3.0:1788666239.541562:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666239.541685:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173655936 00000100:00100000:2.0:1788666239.541696:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173655936 00000100:00100000:2.0:1788666239.541766:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 235 00000100:00100000:2.0:1788666239.541777:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+27:11654:x1875552173655936:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788666239.541883:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea961 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.541903:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea961 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.541918:0:5809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea961 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.542146:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea961 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.542155:0:5809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea961 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.542162:0:5809:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea961 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.542168:0:5809:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666239.542172:0:5809:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea961 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.542193:0:5809:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea961 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.542206:0:5809:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:2.0:1788666239.542209:0:5809:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788666239.542214:0:5809:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea961 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.542220:0:5809:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea961 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5809 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666239.542391:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+28:11654:x1875552173655936:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 615us (839us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788666239.542401:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 235 00000040:00080000:0.0:1788666239.543722:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788666239.543733:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788666239.544259:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788666239.544269:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788666239.560934:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666239.564821:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173656320 00000100:00100000:1.0:1788666239.564845:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173656320 00000100:00100000:1.0:1788666239.564928:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 64 00000100:00100000:1.0:1788666239.564940:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+28:11654:x1875552173656320:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788666239.565240:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1e05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+29:11654:x1875552173656320:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 300us (4314us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788666239.565249:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 64 00000040:00080000:3.0:1788666239.665907:0:12533:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788666239.665924:0:12533:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788666239.666064:0:12533:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788666239.666072:0:12533:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788666239.936288:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666239.938088:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173656576 00000100:00100000:2.0:1788666239.938105:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173656576 00000100:00100000:2.0:1788666239.938177:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 236 00000100:00100000:2.0:1788666239.938187:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+29:11667:x1875552173656576:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666239.938212:0:5808:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666239.938235:0:5808:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea968 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42c50 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.938344:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea96f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.938359:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea96f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.938389:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea96f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666239.938400:0:5808:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788666239.938534:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea968 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c50 expref: 32 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.938555:0:5808:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea96f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c50 expref: 31 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.938564:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:2.0:1788666239.938567:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788666239.938571:0:5808:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2400, rc 0) 00000100:00100000:2.0:1788666239.938703:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+31:11667:x1875552173656576:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 517us (2430us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788666239.938711:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 236 00000100:00100000:0.0:1788666239.944122:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666239.944292:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173656704 00000100:00100000:2.0:1788666239.944308:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173656704 00000100:00100000:2.0:1788666239.944391:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 237 00000100:00100000:2.0:1788666239.944403:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+31:11667:x1875552173656704:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:2.0:1788666239.944518:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea97d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.944539:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.944553:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.944657:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.944665:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea97d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.944673:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea97d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.944680:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666239.944686:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea97d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.944695:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea97d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.944711:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:2.0:1788666239.944714:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788666239.944719:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea97d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666239.944726:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3800/0x96bbe788361ea97d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666239.944830:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0911d461-5865-4ef7-8c3e-012fc04add58+31:11667:x1875552173656704:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 430us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666239.944840:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 237 00000100:00100000:1.0:1788666240.003399:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666240.003455:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666240.003547:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666240.003661:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173657088 00000100:00100000:2.0:1788666240.003673:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173657088 00000100:00100000:2.0:1788666240.003753:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173656960 00000100:00100000:3.0:1788666240.003763:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 100 00000100:00100000:2.0:1788666240.003772:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173656960 00000100:00100000:3.0:1788666240.003782:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+7:2364:x1875552173657088:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666240.003799:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 101 00000100:00100000:2.0:1788666240.003805:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+7:2364:x1875552173656960:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666240.003873:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+7:2364:x1875552173657088:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 100us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666240.003882:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 100 00000100:00100000:0.0:1788666240.003890:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173656832 00000100:00100000:0.0:1788666240.003895:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173656832 00000100:00100000:0.0:1788666240.003925:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 302 00000100:00100000:0.0:1788666240.003931:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173656832:12345-192.168.201.25@tcp:400:kworker.0 00000100:00080000:1.0:1788666240.003992:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788666240.003996:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788666240.006133:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+7:2364:x1875552173656960:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 2301us (2559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666240.006154:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 101 00000100:00100000:1.0:1788666240.009132:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290466c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173656832:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 5180us (5730us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666240.009151:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 302 00000100:00100000:0.0:1788666240.009703:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666240.010111:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173657216 00000100:00100000:3.0:1788666240.010126:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173657216 00000100:00080000:1.0:1788666240.010681:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788666240.012167:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666240.012564:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 167 00000100:00100000:3.0:1788666240.012624:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173657216:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666240.012811:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281326a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173657216:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 234us (3110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666240.012821:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 167 00000100:00100000:0.0:1788666240.056929:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666240.059033:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173657344 00000100:00100000:3.0:1788666240.059052:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173657344 00000100:00100000:3.0:1788666240.059161:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 71 00000100:00100000:3.0:1788666240.059175:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+7:2361:x1875552173657344:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:3.0:1788666240.059198:0:8429:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666240.059225:0:8429:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb206275/0x96bbe788361ea984 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42c57 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788666240.059258:0:8429:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9ce17d, atime: 0x6a9ce17d, ctime: 0x6a9ce17d, blocks: 0xb 00010000:00010000:3.0:1788666240.059287:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=346s v=(0 0) 00010000:00010000:3.0:1788666240.059293:0:8429:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666240.059305:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb206275/0x96bbe788361ea984 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c57 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666240.059323:0:8429:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fb206275/0x96bbe788361ea984 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c57 expref: 8 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666240.059354:0:8429:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e8200, rc 0) 00000100:00100000:3.0:1788666240.059430:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+8:2361:x1875552173657344:12345-192.168.201.25@tcp:101:cat.0 Request processed in 260us (2599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666240.059439:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 71 00000100:00100000:1.0:1788666240.080743:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666240.081119:0:6656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173657472 00000100:00100000:2.0:1788666240.081132:0:6656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173657472 00002000:00100000:2.0:1788666240.081199:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8ab298b95880 x1875552173657472/t0(0) o3->0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp:281/0 lens 488/0 e 0 to 0 dl 1788666251 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788666240.081213:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab298b95880 with x1875552173657472 ext(0->4095) 00002000:00010000:2.0:1788666240.081219:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab298b95880 00000100:00100000:2.0:1788666240.081260:0:6656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:2.0:1788666240.081272:0:6656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0911d461-5865-4ef7-8c3e-012fc04add58+8:2361:x1875552173657472:12345-192.168.201.25@tcp:3:cat.0 00000100:00100000:2.0:1788666240.081922:0:6656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:0911d461-5865-4ef7-8c3e-012fc04add58+8:2361:x1875552173657472:12345-192.168.201.25@tcp:3:cat.0 Request processed in 649us (1191us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788666240.081932:0:6656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00002000:00100000:2.0:1788666240.081941:0:6656:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8ab298b95880 x1875552173657472/t0(0) o3->0911d461-5865-4ef7-8c3e-012fc04add58@192.168.201.25@tcp:281/0 lens 488/4536 e 0 to 0 dl 1788666251 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788666240.081964:0:6656:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8ab298b95880 with x1875552173657472 ext(0->4095) 00002000:00010000:2.0:1788666240.081969:0:6656:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8ab298b95880 00010000:00010000:3.0:1788666241.034917:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788666241.062051:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1788666241.062070:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1788666241.062083:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:0.0:1788666241.419085:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2905ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186222080:0@lo:400:kworker.0 00000100:00100000:0.0:1788666241.419189:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666241.419292:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186222080 00000100:00100000:0.0:1788666241.419301:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186222080 00000100:00100000:0.0:1788666241.419360:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788666241.419371:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3278:x1875552186222080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666241.419454:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290464050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3278:x1875552186222080:12345-0@lo:400:kworker.0 Request processed in 85us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666241.419462:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788666241.419523:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2905ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186222080:0@lo:400:kworker.0 00000100:00100000:3.0:1788666241.419775:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2905ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186222208:0@lo:400:kworker.0 00000100:00100000:3.0:1788666241.419819:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666241.420097:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186222464:0@lo:400:kworker.0 00000100:00100000:2.0:1788666241.420134:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666241.420174:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3276:1875552186222336:0@lo:400:kworker.0 00000100:00100000:2.0:1788666241.420220:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186222464 00000100:00100000:2.0:1788666241.420226:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186222464 00000100:00100000:2.0:1788666241.420274:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788666241.420283:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3277:x1875552186222464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666241.420327:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae50b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3277:x1875552186222464:12345-0@lo:400:kworker.0 Request processed in 45us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666241.420334:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1788666241.420352:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788666241.420391:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae365180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186222464:0@lo:400:kworker.0 00000100:00100000:3.0:1788666241.420465:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186222720:0@lo:400:kworker.0 00000100:00100000:3.0:1788666241.420489:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666241.420521:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186222720 00000100:00100000:3.0:1788666241.420525:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186222720 00000100:00100000:3.0:1788666241.420560:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788666241.420568:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b422bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186222720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666241.420621:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186222208 00000100:00100000:1.0:1788666241.420626:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186222208 00000100:00100000:1.0:1788666241.420671:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788666241.420680:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186222208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666241.420728:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3278:1875552186222592:0@lo:400:kworker.0 00000100:00100000:1.0:1788666241.427626:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4229180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186222208:12345-0@lo:400:kworker.0 Request processed in 6932us (7791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666241.431933:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788666241.432076:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666241.432158:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186222592 00000100:00100000:0.0:1788666241.432168:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186222592 00000100:00100000:0.0:1788666241.432217:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788666241.432227:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab281324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875552186222592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666241.432291:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab281324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875552186222592:12345-0@lo:400:kworker.0 Request processed in 66us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666241.432298:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788666241.432337:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae367800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3278:1875552186222592:0@lo:400:kworker.0 00000100:00100000:2.0:1788666241.432605:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788666241.432795:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788666241.432802:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788666241.432829:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186222336 00000100:00100000:2.0:1788666241.432835:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186222336 00000100:00100000:2.0:1788666241.432872:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788666241.432879:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875552186222336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666241.432923:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae508e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875552186222336:12345-0@lo:400:kworker.0 Request processed in 46us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666241.432930:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00080000:2.0:1788666241.432962:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666241.433002:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3276:1875552186222336:0@lo:400:kworker.0 00000100:00100000:1.0:1788666241.436418:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2905ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186222208:0@lo:400:kworker.0 00000100:00100000:3.0:1788666241.439877:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b422bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186222720:12345-0@lo:400:kworker.0 Request processed in 19301us (19377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666241.439898:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788666241.440035:0:3275:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788666241.440044:0:3275:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788666241.440066:0:3275:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab2bf9fdc00, transno 4294967310 00000100:00100000:1.0:1788666241.440087:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae364700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186222720:0@lo:400:kworker.0 00000100:00100000:1.0:1788666241.933816:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186222848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788666241.933911:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666241.934203:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186222848 00000100:00100000:3.0:1788666241.934213:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186222848 00000100:00100000:3.0:1788666241.934274:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788666241.934284:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186222848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788666241.934329:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666241.942985:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186222848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8689us (9060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666241.943003:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788666241.950753:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186222848:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788666242.064282:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788666242.955141:0:6676:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 349663557179ns, next at 350663554204ns, rc = 0 00000100:00100000:2.0:1788666242.955351:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b4228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186222976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788666242.955465:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666242.955810:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186222976 00000100:00100000:3.0:1788666242.955834:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186222976 00000100:00100000:3.0:1788666242.955905:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788666242.955916:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3277:x1875552186222976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788666242.955963:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666242.956027:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae509880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3277:x1875552186222976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666242.956034:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788666242.956251:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b4228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186222976:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788666243.083802:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788666243.573512:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:2.0:1788666243.573558:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1788666243.597152:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000020:00080000:2.0:1788666243.597179:0:5830:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:2.0:1788666243.597214:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:2.0:1788666243.597225:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1788666243.597228:0:5841:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000004:00080000:2.0:1788666243.597247:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000020:00080000:1.0:1788666243.597250:0:5841:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:2.0:1788666243.597275:0:5830:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8ab2a1516c00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788666243.597282:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab2bfa27900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8ab2a15169c0 00000020:00080000:2.0:1788666243.597285:0:5830:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8ab2bfa27f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8ab287e9a800 00000020:00080000:1.0:1788666243.597427:0:5841:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1788666243.597728:0:5841:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1788666243.602755:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666243.602781:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186223104:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788666243.602876:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666243.602953:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186223104 00000100:00100000:2.0:1788666243.602962:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186223104 00000100:00100000:2.0:1788666243.603032:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788666243.603042:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae364700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186223104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788666243.603373:0:6650:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788666243.604069:0:6650:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788666237 -> 1788666237 00002000:00010000:2.0:1788666243.604072:0:6650:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1788666237 -> 1788666237 00002000:00010000:2.0:1788666243.604074:0:6650:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788666237 -> 1788666237 00002000:00010000:2.0:1788666243.604077:0:6650:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788666243.604221:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae364700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3277:x1875552186223104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1177us (1341us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788666243.604232:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788666243.604270:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788666243.604497:0:3277:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:0.0:1788666243.604504:0:3277:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab2bf9fc380, transno 4294967321 00000004:00080000:0.0:1788666243.604819:0:3277:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:0.0:1788666243.604868:0:3277:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8ab2ae726d80 x1875552186223104/t4294967324(4294967324) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788666259 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788666243.604884:0:3277:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab2ae726d80/2, rc 0, transno 4294967324 00000100:00100000:0.0:1788666243.605765:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae726d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186223104:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1788666244.106993:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666245.125839:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666245.125907:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666245.125940:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666245.126000:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173657600 00000100:00100000:1.0:1788666245.126016:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173657600 00000100:00100000:1.0:1788666245.126099:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 304 00000100:00100000:1.0:1788666245.126111:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173657600:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666245.126199:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290467850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173657600:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 91us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666245.126207:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 304 00000100:00100000:1.0:1788666245.126242:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173657984 00000100:00100000:1.0:1788666245.126245:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173657984 00000100:00100000:1.0:1788666245.126295:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 104 00000100:00100000:1.0:1788666245.126301:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+5:2363:x1875552173657984:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666245.126355:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+5:2363:x1875552173657984:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 53us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666245.126361:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 104 00000100:00100000:3.0:1788666245.126969:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173657728 00000100:00100000:3.0:1788666245.126978:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173657728 00000100:00100000:3.0:1788666245.127052:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 171 00000100:00100000:3.0:1788666245.127062:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+18:2363:x1875552173657728:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666245.127125:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0911d461-5865-4ef7-8c3e-012fc04add58+18:2363:x1875552173657728:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 65us (1303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666245.127131:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 171 00000100:00080000:3.0:1788666245.127238:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788666245.127244:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788666245.132061:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666245.132259:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666245.132297:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666245.132325:0:6650:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173657856 00000100:00100000:3.0:1788666245.132350:0:6650:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173657856 00000100:00100000:3.0:1788666245.132411:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 105 00000100:00100000:3.0:1788666245.132422:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b422b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+7:2364:x1875552173657856:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666245.132534:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b422b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+7:2364:x1875552173657856:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 113us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666245.132543:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 105 00000100:00100000:3.0:1788666245.132573:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173658112 00000100:00100000:3.0:1788666245.132599:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173658112 00000100:00100000:3.0:1788666245.132640:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 172 00000100:00100000:3.0:1788666245.132647:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b422a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173658112:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666245.132680:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b422a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:84416489-fb20-4430-94f5-31470edbb54e+5:2364:x1875552173658112:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 34us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666245.132687:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 172 00000100:00080000:3.0:1788666245.132712:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788666245.132717:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788666246.158685:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666246.410067:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666246.410253:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173658240 00000100:00100000:0.0:1788666246.410264:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173658240 00000100:00100000:0.0:1788666246.410378:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 238 00000100:00100000:0.0:1788666246.410416:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+18:11320:x1875552173658240:12345-192.168.201.25@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788666246.410577:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0911d461-5865-4ef7-8c3e-012fc04add58+18:11320:x1875552173658240:12345-192.168.201.25@tcp:60:lhsmtool_posix.0 Request processed in 173us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666246.410598:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 238 00000100:00100000:3.0:1788666246.424551:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666246.436356:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173658496 00000100:00100000:1.0:1788666246.436393:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173658496 00000100:00100000:1.0:1788666246.436907:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 65 00000100:00100000:1.0:1788666246.436918:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+18:11320:x1875552173658496:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788666246.437292:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+19:11320:x1875552173658496:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 374us (12753us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1788666246.437300:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 65 00000100:00100000:0.0:1788666246.539673:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186223616:0@lo:400:kworker.0 00000100:00100000:0.0:1788666246.539771:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666246.539820:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186223360:0@lo:400:kworker.0 00000100:00100000:2.0:1788666246.539863:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666246.539864:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788666246.539870:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186223488:0@lo:400:kworker.0 00000100:00100000:2.0:1788666246.539884:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186223872:0@lo:400:kworker.0 00000100:00100000:0.0:1788666246.539893:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666246.539922:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666246.539947:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788666246.539950:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186223616 00000100:00100000:2.0:1788666246.539953:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186223232:0@lo:400:kworker.0 00000100:00100000:0.0:1788666246.539958:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186223616 00000100:00100000:2.0:1788666246.539982:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666246.540002:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186223744:0@lo:400:kworker.0 00000100:00100000:0.0:1788666246.540014:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186223872 00000100:00100000:0.0:1788666246.540016:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186223872 00000100:00100000:2.0:1788666246.540024:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666246.540037:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788666246.540045:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3278:x1875552186223616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666246.540194:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186223360 00000100:00100000:3.0:1788666246.540199:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186223360 00000100:00100000:3.0:1788666246.540226:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186223488 00000100:00100000:3.0:1788666246.540228:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186223488 00000100:00100000:3.0:1788666246.540248:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186223744 00000100:00100000:3.0:1788666246.540250:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186223744 00000100:00100000:3.0:1788666246.540266:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788666246.540274:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186223360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666246.540326:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae367800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186223360:12345-0@lo:400:kworker.0 Request processed in 53us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666246.540345:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788666246.540364:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788666246.540370:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186223488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666246.540427:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3278:x1875552186223616:12345-0@lo:400:kworker.0 Request processed in 381us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666246.540436:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788666246.540451:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788666246.540458:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186223872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666246.540494:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae365180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186223872:12345-0@lo:400:kworker.0 Request processed in 29us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666246.540500:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788666246.540517:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186223232 00000100:00100000:0.0:1788666246.540521:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186223232 00000100:00100000:0.0:1788666246.540543:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788666246.540569:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186223232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666246.540623:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290467450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186223232:12345-0@lo:400:kworker.0 Request processed in 55us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666246.540628:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788666246.542037:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788666246.542060:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186223744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666246.542220:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186223744:12345-0@lo:400:kworker.0 Request processed in 171us (2193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666246.542228:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788666246.548037:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186223488:12345-0@lo:400:kworker.0 Request processed in 7654us (8129us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666246.548058:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:3.0:1788666246.548105:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788666246.548113:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788666246.548116:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788666246.548191:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186223232:0@lo:400:kworker.0 00000100:00100000:3.0:1788666246.548215:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186223744:0@lo:400:kworker.0 00000100:00100000:3.0:1788666246.548228:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186223360:0@lo:400:kworker.0 00000100:00100000:3.0:1788666246.548241:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186223872:0@lo:400:kworker.0 00000100:00100000:2.0:1788666246.553880:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186223616:0@lo:400:kworker.0 00000100:00100000:1.0:1788666246.554142:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186223488:0@lo:400:kworker.0 00000100:00100000:3.0:1788666246.724321:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666246.724631:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173658624 00000100:00100000:1.0:1788666246.724642:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173658624 00000100:00100000:1.0:1788666246.724714:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 239 00000100:00100000:1.0:1788666246.724724:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84416489-fb20-4430-94f5-31470edbb54e+5:12118:x1875552173658624:12345-192.168.201.25@tcp:101:lsof.0 00010000:00010000:1.0:1788666246.724747:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666246.724769:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea98b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42c5e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666246.724843:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea992 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666246.724872:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea992 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666246.724887:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea992 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666246.724923:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788666246.724927:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788666246.724949:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea992 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666246.724976:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855000/0x96bbe788361ea98b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c5e expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666246.724994:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea992 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c5e expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666246.725003:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab290a48300) 00010000:00010000:1.0:1788666246.725006:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788666246.725010:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298854200, rc 0) 00000100:00100000:1.0:1788666246.725265:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:84416489-fb20-4430-94f5-31470edbb54e+6:12118:x1875552173658624:12345-192.168.201.25@tcp:101:lsof.0 Request processed in 540us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666246.725274:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 239 00000100:00100000:1.0:1788666247.051624:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788666247.051655:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186224000:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788666247.051761:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666247.051920:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186224000 00000100:00100000:0.0:1788666247.051930:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186224000 00000100:00100000:0.0:1788666247.051995:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788666247.052007:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186224000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788666247.052049:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666247.052112:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186224000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666247.052119:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788666247.052257:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186224000:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788666247.185295:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788666247.755315:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788666247.755325:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788666247.755714:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1788666247.755722:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788666248.075649:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186224128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788666248.075741:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666248.075928:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186224128 00000100:00100000:0.0:1788666248.075947:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186224128 00000100:00100000:0.0:1788666248.076047:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788666248.076061:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875552186224128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788666248.076117:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788666248.076216:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788666248.085261:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3278:x1875552186224128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9187us (9503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666248.085281:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788666248.088411:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186224128:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788666248.204985:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788666248.665636:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1788666248.665660:0:5830:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788666248.665691:0:5841:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788666248.665703:0:5841:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:0.0:1788666248.727091:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:3.0:1788666249.228031:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666250.255034:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666250.262451:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666250.262528:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666250.262659:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173658752 00000100:00100000:0.0:1788666250.262671:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173658752 00000100:00100000:0.0:1788666250.262756:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 306 00000100:00100000:0.0:1788666250.262766:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2363:x1875552173658752:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666250.262859:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290464850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2363:x1875552173658752:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 94us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666250.262875:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 306 00000100:00100000:1.0:1788666250.264651:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666250.264714:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666250.264753:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666250.264840:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173659264 00000100:00100000:0.0:1788666250.264850:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173659264 00000100:00100000:0.0:1788666250.264911:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173658880 00000100:00100000:0.0:1788666250.264915:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173658880 00000100:00100000:0.0:1788666250.264942:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 176 00000100:00100000:0.0:1788666250.264952:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84416489-fb20-4430-94f5-31470edbb54e+6:2363:x1875552173659264:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666250.265034:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84416489-fb20-4430-94f5-31470edbb54e+6:2363:x1875552173659264:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 83us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666250.265042:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 176 00000100:00100000:0.0:1788666250.265059:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 177 00000100:00100000:0.0:1788666250.265065:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+18:2363:x1875552173658880:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666250.265095:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+18:2363:x1875552173658880:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 31us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666250.265102:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 177 00000100:00080000:0.0:1788666250.265257:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666250.270537:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173659008 00000100:00100000:3.0:1788666250.270553:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173659008 00000100:00100000:3.0:1788666250.270669:0:8429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173659136 00000100:00100000:3.0:1788666250.270672:0:8429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173659136 00000100:00100000:2.0:1788666250.272973:0:6650:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 108 00000100:00100000:2.0:1788666250.273012:0:6650:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab298b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173659008:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666250.273106:0:6650:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab298b90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0911d461-5865-4ef7-8c3e-012fc04add58+7:2363:x1875552173659008:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 120us (10578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666250.273114:0:6650:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 108 00000100:00080000:1.0:1788666250.276503:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788666250.276514:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788666250.278196:0:8429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 109 00000100:00100000:3.0:1788666250.278238:0:8429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+5:2363:x1875552173659136:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666250.278349:0:8429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0911d461-5865-4ef7-8c3e-012fc04add58+5:2363:x1875552173659136:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 120us (13594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666250.278357:0:8429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 109 00000001:02000400:0.0:1788666251.192563:0:12739:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 23:44:09 (1788666249) 00010000:00010000:0.0:1788666251.275264:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666251.666156:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186224384:0@lo:400:kworker.0 00000100:00100000:2.0:1788666251.666229:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666251.666299:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186224896:0@lo:400:kworker.0 00000100:00100000:2.0:1788666251.666345:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666251.666595:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788666251.666605:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186224256:0@lo:400:kworker.0 00000100:00100000:2.0:1788666251.666640:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666251.666676:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186224768:0@lo:400:kworker.0 00000100:00100000:2.0:1788666251.666700:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666251.666735:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186224640:0@lo:400:kworker.0 00000100:00100000:2.0:1788666251.666759:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666251.668101:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788666251.668116:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186224512:0@lo:400:kworker.0 00000100:00100000:2.0:1788666251.668159:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666251.668199:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186224384 00000100:00100000:2.0:1788666251.668206:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186224384 00000100:00100000:2.0:1788666251.668254:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186224768 00000100:00100000:2.0:1788666251.668258:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186224768 00000100:00100000:2.0:1788666251.668298:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186224512 00000100:00100000:2.0:1788666251.668303:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186224512 00000100:00100000:2.0:1788666251.668323:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788666251.668330:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186224384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666251.669526:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186224896 00000100:00100000:0.0:1788666251.669538:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186224896 00000100:00100000:0.0:1788666251.669606:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186224640 00000100:00100000:0.0:1788666251.669610:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186224640 00000100:00100000:0.0:1788666251.669637:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788666251.669662:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186224896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666251.669758:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186224896:12345-0@lo:400:kworker.0 Request processed in 103us (3401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666251.669783:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788666251.669801:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788666251.669807:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186224640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666251.669844:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186224640:12345-0@lo:400:kworker.0 Request processed in 37us (3083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666251.669850:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788666251.669872:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788666251.669880:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186224768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666251.669927:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186224768:12345-0@lo:400:kworker.0 Request processed in 47us (3225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666251.669934:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788666251.669949:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788666251.669956:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186224512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666251.669987:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186224512:12345-0@lo:400:kworker.0 Request processed in 32us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666251.669993:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788666251.670013:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186224256 00000100:00100000:0.0:1788666251.670017:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186224256 00000100:00100000:0.0:1788666251.670039:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788666251.670045:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186224256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666251.670074:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290467050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186224256:12345-0@lo:400:kworker.0 Request processed in 29us (3434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666251.670080:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00080000:0.0:1788666251.670161:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788666251.670165:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788666251.670175:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666251.670214:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1abb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186224256:0@lo:400:kworker.0 00000100:00100000:0.0:1788666251.670232:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186224768:0@lo:400:kworker.0 00000100:00100000:0.0:1788666251.670243:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186224896:0@lo:400:kworker.0 00000100:00100000:2.0:1788666251.671166:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186224384:12345-0@lo:400:kworker.0 Request processed in 2832us (4933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666251.671177:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788666251.671226:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186224512:0@lo:400:kworker.0 00000100:00100000:2.0:1788666251.671238:0:3278:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:2.0:1788666251.671243:0:3278:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab2ae726d80, transno 4294967324 00000100:00100000:2.0:1788666251.671257:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1abaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186224640:0@lo:400:kworker.0 00000100:00100000:0.0:1788666251.674176:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186224384:0@lo:400:kworker.0 00000100:00100000:0.0:1788666252.172442:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788666252.172461:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186225024:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788666252.172518:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666252.172563:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186225024 00000100:00100000:3.0:1788666252.172572:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186225024 00000100:00100000:3.0:1788666252.172662:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788666252.172673:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186225024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788666252.172710:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666252.172926:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186225024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 255us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666252.172935:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788666252.173259:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186225024:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788666252.298981:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666253.197780:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666253.197816:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b46b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186225152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788666253.197902:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666253.198985:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186225152 00000100:00100000:2.0:1788666253.199000:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186225152 00000100:00100000:2.0:1788666253.199090:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788666253.199101:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1abaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186225152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788666253.199154:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666253.199228:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1abaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186225152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666253.199236:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1788666253.199259:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788666253.199316:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b46b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186225152:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788666253.322867:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666254.346977:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666255.364466:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666255.364510:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666255.364633:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666255.364653:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666255.364698:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666255.364769:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173659904 00000100:00100000:0.0:1788666255.364779:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173659904 00000100:00100000:0.0:1788666255.364843:0:7132:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173659520 00000100:00100000:0.0:1788666255.364846:0:7132:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173659520 00000100:00100000:0.0:1788666255.364877:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 181 00000100:00100000:0.0:1788666255.364887:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84416489-fb20-4430-94f5-31470edbb54e+6:2361:x1875552173659904:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666255.364988:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:84416489-fb20-4430-94f5-31470edbb54e+6:2361:x1875552173659904:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 102us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666255.364996:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 181 00000100:00100000:0.0:1788666255.365018:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 182 00000100:00100000:0.0:1788666255.365025:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bf9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+18:2361:x1875552173659520:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666255.365048:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bf9fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0911d461-5865-4ef7-8c3e-012fc04add58+18:2361:x1875552173659520:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 25us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666255.365054:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 182 00000100:00080000:0.0:1788666255.365075:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666255.365373:0:5802:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173659392 00000100:00100000:2.0:1788666255.365379:0:5802:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173659392 00000100:00100000:2.0:1788666255.365417:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 308 00000100:00100000:2.0:1788666255.365425:0:5802:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2361:x1875552173659392:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666255.365460:0:5802:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290465450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2361:x1875552173659392:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 36us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666255.365465:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 308 00000100:00100000:1.0:1788666255.371484:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173659648 00000100:00100000:1.0:1788666255.371501:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173659648 00000100:00100000:1.0:1788666255.371650:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173659776 00000100:00100000:1.0:1788666255.371654:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173659776 00000100:00100000:3.0:1788666255.371716:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 112 00000100:00100000:3.0:1788666255.371729:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b46b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+7:2361:x1875552173659648:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666255.371813:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b46b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+7:2361:x1875552173659648:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 88us (7302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666255.371833:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 112 00000100:00080000:2.0:1788666255.372658:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788666255.372664:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788666255.374680:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 113 00000100:00100000:1.0:1788666255.374707:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+5:2361:x1875552173659776:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666255.374787:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+5:2361:x1875552173659776:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 85us (10088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666255.374795:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 113 00010000:00010000:0.0:1788666255.376301:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666255.510991:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666255.511117:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173660160 00000100:00100000:1.0:1788666255.511127:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173660160 00000100:00100000:1.0:1788666255.511187:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 66 00000100:00100000:1.0:1788666255.511196:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+18:12339:x1875552173660160:12345-192.168.201.25@tcp:35:umount.0 00000100:00100000:1.0:1788666255.512824:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+19:12339:x1875552173660160:12345-192.168.201.25@tcp:35:umount.0 Request processed in 1621us (1837us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788666255.512837:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 66 00000100:00100000:0.0:1788666255.524356:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666255.524460:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173660416 00000100:00100000:2.0:1788666255.524470:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173660416 00000100:00100000:2.0:1788666255.524525:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 67 00000100:00100000:2.0:1788666255.524535:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+19:12339:x1875552173660416:12345-192.168.201.25@tcp:35:umount.0 00000100:00100000:2.0:1788666255.525067:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0911d461-5865-4ef7-8c3e-012fc04add58+20:12339:x1875552173660416:12345-192.168.201.25@tcp:35:umount.0 Request processed in 531us (718us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1788666255.525077:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 67 00000100:00100000:3.0:1788666255.527112:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666255.527217:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173660672 00000100:00100000:1.0:1788666255.527227:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173660672 00000100:00100000:1.0:1788666255.527278:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:1.0:1788666255.527287:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab28f365850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+20:12339:x1875552173660672:12345-192.168.201.25@tcp:35:umount.0 00000100:00100000:1.0:1788666255.527537:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab28f365850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0911d461-5865-4ef7-8c3e-012fc04add58+21:12339:x1875552173660672:12345-192.168.201.25@tcp:35:umount.0 Request processed in 249us (432us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1788666255.527560:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 68 00000100:00100000:0.0:1788666255.529674:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666255.529808:0:11980:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173660928 00000100:00100000:3.0:1788666255.529816:0:11980:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173660928 00000100:00100000:3.0:1788666255.529873:0:11980:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:3.0:1788666255.529882:0:11980:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+21:12339:x1875552173660928:12345-192.168.201.25@tcp:35:umount.0 00000100:00100000:3.0:1788666255.530245:0:11980:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:0911d461-5865-4ef7-8c3e-012fc04add58+22:12339:x1875552173660928:12345-192.168.201.25@tcp:35:umount.0 Request processed in 363us (578us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788666255.530254:0:11980:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 69 00000100:00100000:0.0:1788666255.533609:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666255.533653:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666255.533745:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173661056 00000100:00100000:3.0:1788666255.533756:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173661056 00000100:00100000:3.0:1788666255.533818:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173661184 00000100:00100000:3.0:1788666255.533822:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173661184 00000100:00100000:3.0:1788666255.533841:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:3.0:1788666255.533851:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a096cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17385a9f-d911-4baa-b21a-4b6dd266f57e+14:2364:x1875552173661056:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666255.533867:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666255.533887:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab280030e00/0x96bbe788361e9a0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427e9 expref: 14 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666255.533905:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666255.533958:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a096cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17385a9f-d911-4baa-b21a-4b6dd266f57e+13:2364:x1875552173661056:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 108us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666255.533965:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:3.0:1788666255.534017:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:3.0:1788666255.534023:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17385a9f-d911-4baa-b21a-4b6dd266f57e+12:2364:x1875552173661184:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666255.534032:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666255.534056:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2a1d7dc00/0x96bbe788361e9970 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427b1 expref: 12 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666255.534066:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666255.534086:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa74a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17385a9f-d911-4baa-b21a-4b6dd266f57e+11:2364:x1875552173661184:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 63us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666255.534092:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:0.0:1788666255.536894:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666255.536984:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173661312 00000100:00100000:3.0:1788666255.536995:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173661312 00000100:00100000:3.0:1788666255.537061:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:3.0:1788666255.537071:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17385a9f-d911-4baa-b21a-4b6dd266f57e+11:2363:x1875552173661312:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666255.537087:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666255.537109:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2b47f3a00/0x96bbe788361e9c1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428b4 expref: 11 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666255.537124:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666255.537188:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2363:x1875552173661312:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 118us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666255.537196:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:0.0:1788666255.541720:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666255.541868:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173661440 00000100:00100000:3.0:1788666255.541880:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173661440 00000100:00100000:3.0:1788666255.541934:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 73 00000100:00100000:3.0:1788666255.541944:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+5:2357:x1875552173661440:12345-192.168.201.25@tcp:9:umount.0 00000020:00000080:3.0:1788666255.541976:0:6651:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e9ce2 00000100:00080000:3.0:1788666255.541986:0:6651:0:(import.c:65:import_set_state_nolock()) ffff8ab298ba0000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788666255.542041:0:6651:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1788666255.542347:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0911d461-5865-4ef7-8c3e-012fc04add58+2:2357:x1875552173661440:12345-192.168.201.25@tcp:9:umount.0 Request processed in 401us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666255.542367:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 73 00010000:00010000:1.0:1788666255.542442:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666255.547536:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666255.548051:0:6649:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173661824 00000100:00100000:1.0:1788666255.548064:0:6649:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173661824 00000100:00100000:1.0:1788666255.548127:0:6649:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 74 00000100:00100000:1.0:1788666255.548138:0:6649:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+7:2357:x1875552173661824:12345-192.168.201.25@tcp:9:umount.0 00000020:00000080:1.0:1788666255.548177:0:6649:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e9f43 00000020:00010000:1.0:1788666255.548187:0:6649:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ab2bc3c2000: total 0 00000100:00080000:1.0:1788666255.548191:0:6649:0:(import.c:65:import_set_state_nolock()) ffff8ab2bc3c4800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788666255.548241:0:6649:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788666255.548642:0:6649:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0911d461-5865-4ef7-8c3e-012fc04add58+5:2357:x1875552173661824:12345-192.168.201.25@tcp:9:umount.0 Request processed in 504us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666255.548650:0:6649:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 74 00000020:00010000:0.0:1788666255.548937:0:5797:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ab2bc3c2000: total 0 00010000:00010000:0.0:1788666255.548976:0:5797:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ab2bc3c2000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788666255.549037:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb206275/0x96bbe788361ea984 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c57 expref: 4 pid: 8429 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666255.549076:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032a76ac0/0x96bbe788361ea2e6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a89 expref: 3 pid: 6651 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666255.549091:0:5797:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ab2bc3c2000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788666255.549102:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666255.549104:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666255.549106:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666255.558215:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666255.558356:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173662848 00000100:00100000:3.0:1788666255.558366:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173662848 00000100:00100000:3.0:1788666255.558427:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 240 00000100:00100000:3.0:1788666255.558438:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+22:2357:x1875552173662848:12345-192.168.201.25@tcp:39:umount.0 00000020:00000080:3.0:1788666255.558477:0:5808:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e997e 00000020:00010000:3.0:1788666255.558492:0:5808:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ab2b44de800: total 0 00000100:00080000:3.0:1788666255.558497:0:5808:0:(import.c:65:import_set_state_nolock()) ffff8ab2b44dd000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788666255.558531:0:5808:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:1.0:1788666255.558816:0:5796:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ab2b44de800: total 0 00010000:00010000:1.0:1788666255.558858:0:5796:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ab2b44de800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788666255.558892:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:1.0:1788666255.558896:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788666255.558904:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ea364 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42aac expref: 21 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666255.558924:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:1.0:1788666255.558926:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788666255.558930:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3c00/0x96bbe788361ea1c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a3c expref: 20 pid: 12001 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666255.558945:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:1.0:1788666255.558948:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788666255.558968:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe200/0x96bbe788361e9cb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428de expref: 19 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666255.558981:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:1.0:1788666255.558984:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788666255.558987:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f000/0x96bbe788361ea865 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c0a expref: 18 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666255.558999:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab2908f2b00) 00010000:00010000:1.0:1788666255.559001:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666255.559005:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854000/0x96bbe788361e9c64 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428c9 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666255.559021:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:1.0:1788666255.559023:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788666255.559026:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ea00/0x96bbe788361ea945 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c42 expref: 16 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666255.559035:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab290a48300) 00010000:00010000:1.0:1788666255.559037:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788666255.559040:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab28144b400/0x96bbe788361ea348 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42aa5 expref: 15 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666255.559052:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:1.0:1788666255.559054:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788666255.559057:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854400/0x96bbe788361ea2a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a74 expref: 14 pid: 7132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666255.559068:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ab2a088ea00) 00010000:00010000:1.0:1788666255.559076:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788666255.559081:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f3400/0x96bbe788361e9c48 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428c2 expref: 13 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666255.559097:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8ab290a48e00) 00010000:00010000:1.0:1788666255.559099:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788666255.559102:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814fe600/0x96bbe788361ea2d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42a82 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666255.559115:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:1.0:1788666255.559118:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788666255.559122:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854600/0x96bbe788361ea643 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42b7e expref: 11 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666255.559135:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8ab290a48400) 00010000:00010000:1.0:1788666255.559137:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788666255.559140:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47f2400/0x96bbe788361ea96f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c50 expref: 10 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666255.559154:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8ab2b9e72900) 00010000:00010000:1.0:1788666255.559155:0:5796:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788666255.559159:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2814ff800/0x96bbe788361e9fa5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d429b0 expref: 9 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666255.559170:0:5796:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ab2b44de800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788666255.559181:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666255.559183:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666255.559185:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666255.559909:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0911d461-5865-4ef7-8c3e-012fc04add58+7:2357:x1875552173662848:12345-192.168.201.25@tcp:39:umount.0 Request processed in 1467us (1698us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788666255.559921:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 240 00000001:00100000:0.0:1788666256.367620:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0911d461-5865-4ef7-8c3e-012fc04add58 00000020:00000080:0.0:1788666256.367630:0:7606:0:(genops.c:885:class_export_put()) final put ffff8ab298ba7800/0911d461-5865-4ef7-8c3e-012fc04add58 00000020:00000080:1.0:1788666256.367758:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab298ba7800/0911d461-5865-4ef7-8c3e-012fc04add58 for lustre-OST0001 00000020:00000080:1.0:1788666256.367823:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab298ba0000 for lustre-OST0001 00010000:00010000:0.0:1788666256.394840:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666256.778878:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788666256.778943:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788666256.778968:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186225408:0@lo:400:kworker.0 00000100:00100000:3.0:1788666256.779053:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666256.779467:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186225408 00000100:00100000:1.0:1788666256.779475:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186225408 00000100:00100000:1.0:1788666256.779534:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788666256.779544:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186225408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666256.779626:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186225408:12345-0@lo:400:kworker.0 Request processed in 83us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666256.779634:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788666256.779728:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186225408:0@lo:400:kworker.0 00000100:00100000:2.0:1788666256.780236:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186225280:0@lo:400:kworker.0 00000100:00100000:2.0:1788666256.780280:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666256.780422:0:5800:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186225280 00000100:00100000:1.0:1788666256.780427:0:5800:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186225280 00000100:00100000:1.0:1788666256.780467:0:5800:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788666256.780473:0:5800:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186225280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666256.780525:0:5800:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290465050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186225280:12345-0@lo:400:kworker.0 Request processed in 52us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666256.780531:0:5800:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:3.0:1788666256.780613:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186225280:0@lo:400:kworker.0 00000100:00100000:2.0:1788666256.780952:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186225536:0@lo:400:kworker.0 00000100:00100000:2.0:1788666256.780983:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666256.781139:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186225920:0@lo:400:kworker.0 00000100:00100000:0.0:1788666256.781171:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666256.781194:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788666256.781200:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186225792:0@lo:400:kworker.0 00000100:00100000:2.0:1788666256.781288:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666256.781293:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186225664:0@lo:400:kworker.0 00000100:00100000:2.0:1788666256.781346:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666256.781469:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186225920 00000100:00100000:3.0:1788666256.781474:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186225920 00000100:00100000:3.0:1788666256.781522:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186225664 00000100:00100000:3.0:1788666256.781525:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186225664 00000100:00100000:3.0:1788666256.781546:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788666256.781554:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186225920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666256.781621:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186225920:12345-0@lo:400:kworker.0 Request processed in 68us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666256.781646:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788666256.781660:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788666256.781666:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1aba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186225664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666256.781711:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1aba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186225664:12345-0@lo:400:kworker.0 Request processed in 38us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666256.781718:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:2.0:1788666256.781870:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788666256.781876:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788666256.781934:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186225664:0@lo:400:kworker.0 00000100:00100000:0.0:1788666256.782031:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666256.782360:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186225920:0@lo:400:kworker.0 00000100:00100000:1.0:1788666256.782440:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186225536 00000100:00100000:1.0:1788666256.782446:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186225536 00000100:00080000:0.0:1788666256.782541:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788666256.782572:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186225792 00000100:00100000:1.0:1788666256.782577:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186225792 00000100:00080000:0.0:1788666256.782645:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666256.782700:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788666256.782709:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186225536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666256.782908:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186225536:12345-0@lo:400:kworker.0 Request processed in 200us (1923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666256.782916:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788666256.782931:0:7132:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788666256.782938:0:7132:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186225792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666256.782972:0:7132:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3276:x1875552186225792:12345-0@lo:400:kworker.0 Request processed in 35us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666256.782978:0:7132:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788666256.783044:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186225536:0@lo:400:kworker.0 00000100:00100000:0.0:1788666256.783071:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3276:1875552186225792:0@lo:400:kworker.0 00000100:00100000:3.0:1788666257.291001:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186226048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788666257.291081:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666257.291666:0:6653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186226048 00000100:00100000:2.0:1788666257.291687:0:6653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186226048 00000100:00100000:2.0:1788666257.291858:0:6653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788666257.291868:0:6653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186226048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788666257.291905:0:6653:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666257.291964:0:6653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186226048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666257.291971:0:6653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788666257.292144:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186226048:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788666257.420454:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666257.842498:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666257.842554:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666257.842656:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173662976 00000100:00100000:0.0:1788666257.842667:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173662976 00000100:00100000:0.0:1788666257.842743:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173663104 00000100:00100000:0.0:1788666257.842747:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173663104 00000100:00100000:0.0:1788666257.842767:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:0.0:1788666257.842777:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17385a9f-d911-4baa-b21a-4b6dd266f57e+11:2362:x1875552173662976:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788666257.842795:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666257.842816:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361e9a57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42828 expref: 11 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666257.842835:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666257.842899:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17385a9f-d911-4baa-b21a-4b6dd266f57e+10:2362:x1875552173662976:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 123us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666257.842907:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:0.0:1788666257.842926:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:0.0:1788666257.842933:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17385a9f-d911-4baa-b21a-4b6dd266f57e+9:2362:x1875552173663104:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788666257.842941:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666257.842949:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2b47f3000/0x96bbe788361e9c17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d428ad expref: 9 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666257.842959:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666257.842994:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17385a9f-d911-4baa-b21a-4b6dd266f57e+8:2362:x1875552173663104:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 62us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666257.843001:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:0.0:1788666257.844124:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666257.844197:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173663232 00000100:00100000:3.0:1788666257.844205:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173663232 00000100:00100000:3.0:1788666257.844329:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:3.0:1788666257.844340:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17385a9f-d911-4baa-b21a-4b6dd266f57e+8:2361:x1875552173663232:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666257.844359:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666257.844375:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2a1d7c200/0x96bbe788361e9a50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427fe expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666257.844401:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666257.844449:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:17385a9f-d911-4baa-b21a-4b6dd266f57e+7:2361:x1875552173663232:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 111us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666257.844457:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:2.0:1788666257.858245:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666257.858371:0:12001:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173663488 00000100:00100000:3.0:1788666257.858404:0:12001:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173663488 00000100:00100000:3.0:1788666257.858490:0:12001:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 241 00000100:00100000:3.0:1788666257.858502:0:12001:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84416489-fb20-4430-94f5-31470edbb54e+6:2357:x1875552173663488:12345-192.168.201.25@tcp:39:umount.0 00000020:00000080:3.0:1788666257.858551:0:12001:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e9a65 00000020:00010000:3.0:1788666257.858560:0:12001:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ab2ae439000: total 0 00000100:00080000:3.0:1788666257.858565:0:12001:0:(import.c:65:import_set_state_nolock()) ffff8ab2ae43b000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788666257.858631:0:12001:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00080000:0.0:1788666257.858854:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666257.859171:0:12001:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:84416489-fb20-4430-94f5-31470edbb54e+5:2357:x1875552173663488:12345-192.168.201.25@tcp:39:umount.0 Request processed in 670us (935us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788666257.859180:0:12001:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 241 00000020:00010000:1.0:1788666257.860000:0:5797:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ab2ae439000: total 0 00010000:00010000:1.0:1788666257.860047:0:5797:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ab2ae439000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788666257.860096:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab290a48300) 00010000:00010000:1.0:1788666257.860100:0:5797:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788666257.860110:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854200/0x96bbe788361ea992 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c5e expref: 4 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666257.860132:0:5797:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ab2ae439000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788666257.860155:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666257.860158:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666257.860159:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666257.888243:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666257.888337:0:5801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173663744 00000100:00100000:1.0:1788666257.888349:0:5801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173663744 00000100:00100000:1.0:1788666257.888427:0:5801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 310 00000100:00100000:1.0:1788666257.888440:0:5801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+7:2357:x1875552173663744:12345-192.168.201.25@tcp:251:umount.0 00000020:00000080:1.0:1788666257.888498:0:5801:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e995b 00000020:00010000:1.0:1788666257.888507:0:5801:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ab2b44d9800: total 0 00000100:00080000:1.0:1788666257.888512:0:5801:0:(import.c:65:import_set_state_nolock()) ffff8ab2b44db000 : changing import state from FULL to CLOSED 00000020:00010000:3.0:1788666257.888605:0:5796:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ab2b44d9800: total 0 00010000:00010000:3.0:1788666257.888610:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666257.888626:0:5801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290467c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:17385a9f-d911-4baa-b21a-4b6dd266f57e+3:2357:x1875552173663744:12345-192.168.201.25@tcp:251:umount.0 Request processed in 189us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666257.888634:0:5801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 310 00010000:00010000:3.0:1788666257.888660:0:5796:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ab2b44d9800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788666257.888692:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab280030400/0x96bbe788361e9a11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d427f0 expref: 2 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666257.888707:0:5796:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ab2b44d9800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788666257.888717:0:5796:0:(genops.c:885:class_export_put()) final put ffff8ab2b44d9800/17385a9f-d911-4baa-b21a-4b6dd266f57e 00010000:00010000:3.0:1788666257.888847:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666257.888850:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666257.888852:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788666257.888890:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2b44d9800/17385a9f-d911-4baa-b21a-4b6dd266f57e for MGS 00000020:00000080:1.0:1788666257.888933:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab2b44db000 for MGS 00000040:00080000:0.0:1788666257.998990:0:11650:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788666257.999001:0:11650:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788666257.999385:0:11650:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788666257.999393:0:11650:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788666258.315876:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666258.315897:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186226176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788666258.315960:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666258.316048:0:6652:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186226176 00000100:00100000:3.0:1788666258.316055:0:6652:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186226176 00000100:00100000:3.0:1788666258.316108:0:6652:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788666258.316117:0:6652:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1aba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186226176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788666258.316149:0:6652:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666258.316190:0:6652:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1aba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186226176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666258.316205:0:6652:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788666258.316250:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186226176:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788666258.316301:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788666258.442831:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788666258.886233:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:2.0:1788666258.886251:0:5830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 84416489-fb20-4430-94f5-31470edbb54e 00000001:00080000:2.0:1788666258.886256:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:2.0:1788666258.886260:0:5830:0:(genops.c:885:class_export_put()) final put ffff8ab2ae439000/84416489-fb20-4430-94f5-31470edbb54e 00000001:00100000:2.0:1788666258.886268:0:5830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0911d461-5865-4ef7-8c3e-012fc04add58 00000001:00080000:2.0:1788666258.886282:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:2.0:1788666258.886287:0:5830:0:(genops.c:885:class_export_put()) final put ffff8ab2b44de800/0911d461-5865-4ef7-8c3e-012fc04add58 00000020:00000080:2.0:1788666258.889466:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2ae439000/84416489-fb20-4430-94f5-31470edbb54e for lustre-MDT0000 00000020:00000080:2.0:1788666258.889539:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2b44de800/0911d461-5865-4ef7-8c3e-012fc04add58 for lustre-MDT0000 00000020:00000080:2.0:1788666258.889572:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab2ae43b000 for lustre-MDT0000 00000020:00000080:2.0:1788666258.889594:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab2b44dd000 for lustre-MDT0000 00000001:00100000:0.0:1788666258.936767:0:6678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0911d461-5865-4ef7-8c3e-012fc04add58 00000020:00000080:0.0:1788666258.936778:0:6678:0:(genops.c:885:class_export_put()) final put ffff8ab2bc3c2000/0911d461-5865-4ef7-8c3e-012fc04add58 00000020:00000080:0.0:1788666258.936822:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2bc3c2000/0911d461-5865-4ef7-8c3e-012fc04add58 for lustre-OST0000 00000020:00000080:0.0:1788666258.936882:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab2bc3c4800 for lustre-OST0000 00010000:00010000:0.0:1788666259.484926:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788666259.683092:0:12939:0:(tgt_mount.c:2197:server_umount_begin()) umount -f 00000020:01000004:2.0:1788666259.707141:0:12939:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788666259.707312:0:12939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4e00/0x96bbe788361e99e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99e7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666259.707347:0:12939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4e00/0x96bbe788361e99e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e99e7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666259.707355:0:12939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4e00/0x96bbe788361e99e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x96bbe788361e99e7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666259.707362:0:12939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4e00/0x96bbe788361e99e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x96bbe788361e99e7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666259.707484:0:12939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788666259.707490:0:12939:0:(mgc_request.c:545:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788666259.707517:0:12939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788666259.707521:0:12939:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788666259.707526:0:12939:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788666259.707551:0:12939:0:(import.c:65:import_set_state_nolock()) ffff8ab2b4223000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788666259.715332:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875552186226304:0@lo:39:umount.0 00000100:00100000:3.0:1788666259.715422:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666259.715736:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186226304 00000100:00100000:2.0:1788666259.715746:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186226304 00000100:00100000:2.0:1788666259.715802:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788666259.715813:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875552186226304:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788666259.715841:0:5809:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e976a 00000100:00080000:2.0:1788666259.715850:0:5809:0:(import.c:65:import_set_state_nolock()) ffff8ab2a02ef800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788666259.717787:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666259.717800:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4e00/0x96bbe788361e99e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x96bbe788361e99e7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666259.717811:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4e00 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:1.0:1788666259.717815:0:5797:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4e00/0x96bbe788361e99e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x96bbe788361e99e7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666259.717825:0:5797:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4e00/0x96bbe788361e99e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x96bbe788361e99e7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666259.717832:0:5797:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4e00/0x96bbe788361e99e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x96bbe788361e99e7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666259.717837:0:5797:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788666259.717856:0:5797:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788666259.717859:0:5797:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788666259.717897:0:5797:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4e00/0x96bbe788361e99e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x96bbe788361e99e7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666259.717904:0:5797:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788666259.717944:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4e00/0x96bbe788361e99e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x96bbe788361e99e7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666259.717951:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4e00/0x96bbe788361e99e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x96bbe788361e99e7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666259.717961:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666259.717962:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666259.717964:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666259.718101:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186226432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788666259.718176:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666259.718815:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186226432 00000100:00100000:1.0:1788666259.718823:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186226432 00000100:00100000:1.0:1788666259.718872:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788666259.718881:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+19:3275:x1875552186226432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788666259.718896:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666259.718913:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab283fd4600/0x96bbe788361e99e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96bbe788361e99e0 expref: 19 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666259.718925:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666259.718968:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+18:3275:x1875552186226432:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666259.718974:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788666259.719015:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186226432:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788666259.719785:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666259.719881:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3274:x1875552186226304:12345-0@lo:39:umount.0 Request processed in 3796us (4184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666259.719896:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1788666259.719910:0:5809:0:(genops.c:885:class_export_put()) final put ffff8ab2b4213000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788666259.719990:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2b4213000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788666259.720041:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab2a02ef800 for lustre-MDT0000 00000100:00080000:1.0:1788666259.720323:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab2b4223000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788666259.720344:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875552186226304:0@lo:39:umount.0 00000100:00080000:2.0:1788666259.720882:0:12939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788666259.720887:0:12939:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788666259.720900:0:12939:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788666259.726456:0:12939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e99ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.726476:0:12939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e99ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e99f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.726484:0:12939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e99ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x96bbe788361e99f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.726491:0:12939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e99ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x96bbe788361e99f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.726522:0:12939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666259.726529:0:12939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7da00/0x96bbe788361e9915 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e991c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.726535:0:12939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7da00/0x96bbe788361e9915 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e991c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.726561:0:12939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7da00/0x96bbe788361e9915 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x96bbe788361e991c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.726567:0:12939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7da00/0x96bbe788361e9915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x96bbe788361e991c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.726620:0:12939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788666259.726935:0:7594:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788666259.726943:0:7594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e99ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x96bbe788361e99f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666259.726951:0:7594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814ff600 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:2.0:1788666259.726954:0:7594:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e99ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x96bbe788361e99f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666259.726964:0:7594:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e99ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x96bbe788361e99f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788666259.726972:0:7594:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e99ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x96bbe788361e99f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666259.726977:0:7594:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788666259.726980:0:7594:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:2.0:1788666259.727019:0:7594:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e99ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x96bbe788361e99f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666259.727026:0:7594:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788666259.727053:0:7594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e99ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x96bbe788361e99f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666259.727061:0:7594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab2814ff600/0x96bbe788361e99ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x96bbe788361e99f5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666259.727075:0:7594:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666259.727078:0:7594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7da00/0x96bbe788361e9915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x96bbe788361e991c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666259.727095:0:7594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7da00 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:2.0:1788666259.727098:0:7594:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7da00/0x96bbe788361e9915 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x96bbe788361e991c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666259.727104:0:7594:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7da00/0x96bbe788361e9915 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x96bbe788361e991c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788666259.727111:0:7594:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7da00/0x96bbe788361e9915 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x96bbe788361e991c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666259.727116:0:7594:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788666259.727119:0:7594:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788666259.727121:0:7594:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788666259.727135:0:7594:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7da00/0x96bbe788361e9915 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x96bbe788361e991c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666259.727142:0:7594:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788666259.727374:0:12939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab298854800/0x96bbe788361e9c09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9c10 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.727516:0:12939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab298854800/0x96bbe788361e9c09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9c10 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.727524:0:12939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab298854800/0x96bbe788361e9c09 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x96bbe788361e9c10 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.727530:0:12939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff8ab298854800/0x96bbe788361e9c09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x96bbe788361e9c10 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.727544:0:12939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666259.727550:0:12939:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4200/0x96bbe788361e96c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e96d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.727555:0:12939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4200/0x96bbe788361e96c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e96d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.727561:0:12939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4200/0x96bbe788361e96c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x96bbe788361e96d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666259.727989:0:7593:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666259.727996:0:7593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab298854800/0x96bbe788361e9c09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x96bbe788361e9c10 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666259.728003:0:7593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298854800 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:1.0:1788666259.728007:0:7593:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab298854800/0x96bbe788361e9c09 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x96bbe788361e9c10 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666259.728014:0:7593:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab298854800/0x96bbe788361e9c09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x96bbe788361e9c10 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666259.728021:0:7593:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab298854800/0x96bbe788361e9c09 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x96bbe788361e9c10 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666259.728026:0:7593:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788666259.728028:0:7593:0:(mgc_request.c:942:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788666259.728030:0:7593:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788666259.728050:0:7593:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab298854800/0x96bbe788361e9c09 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x96bbe788361e9c10 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666259.728056:0:7593:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788666259.728115:0:7594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7da00/0x96bbe788361e9915 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x96bbe788361e991c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666259.728123:0:7594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7da00/0x96bbe788361e9915 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x96bbe788361e991c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666259.728139:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666259.728141:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666259.728142:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666259.728172:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186226560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788666259.728244:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666259.728320:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186226688:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788666259.728353:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788666259.728415:0:12939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4200/0x96bbe788361e96c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x96bbe788361e96d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.728431:0:12939:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788666259.728436:0:12939:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1788666259.728439:0:12939:0:(mgc_request.c:545:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1788666259.728474:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666259.728478:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4200/0x96bbe788361e96c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x96bbe788361e96d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.728485:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4200 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:3.0:1788666259.728487:0:5796:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4200/0x96bbe788361e96c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x96bbe788361e96d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.728494:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4200/0x96bbe788361e96c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x96bbe788361e96d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788666259.728501:0:5796:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4200/0x96bbe788361e96c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x96bbe788361e96d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666259.728506:0:5796:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788666259.728509:0:5796:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1788666259.728511:0:5796:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1788666259.728525:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4200/0x96bbe788361e96c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x96bbe788361e96d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.728530:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788666259.728541:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4200/0x96bbe788361e96c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x96bbe788361e96d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.728557:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4200/0x96bbe788361e96c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x96bbe788361e96d0 expref: -99 pid: 5789 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.728568:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666259.728570:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666259.728572:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788666259.728610:0:12939:0:(tgt_mount.c:2117:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788666259.728614:0:12939:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788666259.728619:0:12939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788666259.728625:0:12939:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788666259.728888:0:12939:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ab2865e6000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788666259.728895:0:12939:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8ab2bfc18800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788666259.728899:0:12939:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8ab2b48219c0) has exports, disconnecting them 00000020:00080000:3.0:1788666259.728903:0:12939:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ab2865e6000), last request at 1788666256 00000020:00000080:3.0:1788666259.728912:0:12939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e98dd 00000100:00080000:3.0:1788666259.728928:0:12939:0:(import.c:65:import_set_state_nolock()) ffff8ab2865e4000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788666259.728972:0:12939:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab2865e6000): rc 0 00000020:00000080:3.0:1788666259.728975:0:12939:0:(genops.c:885:class_export_put()) final put ffff8ab2865e6000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788666259.728986:0:12939:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8ab2bfc18800), last request at 1788666256 00000020:00000080:3.0:1788666259.728989:0:12939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e9804 00000100:00080000:3.0:1788666259.728995:0:12939:0:(import.c:65:import_set_state_nolock()) ffff8ab2bfc1e800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788666259.729005:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788666259.729012:0:12939:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab2bfc18800): rc 0 00000020:00000080:3.0:1788666259.729014:0:12939:0:(genops.c:885:class_export_put()) final put ffff8ab2bfc18800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1788666259.729021:0:12939:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffacf70145bae8 00000100:00080000:3.0:1788666259.729041:0:12939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788666259.729044:0:12939:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1788666259.729061:0:12939:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788666259.729137:0:12939:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788666259.729165:0:12939:0:(import.c:65:import_set_state_nolock()) ffff8ab1811e0800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788666259.729178:0:12939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788666259.729181:0:12939:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1788666259.729190:0:12939:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788666259.729249:0:12939:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788666259.729269:0:12939:0:(import.c:65:import_set_state_nolock()) ffff8ab18119c800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788666259.729300:0:12939:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8ab2b48219c0) has no exports 00000100:00100000:3.0:1788666259.730925:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186226560 00000100:00100000:3.0:1788666259.730939:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186226560 00000100:00100000:3.0:1788666259.731016:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186226688 00000100:00100000:3.0:1788666259.731020:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186226688 00000100:00100000:3.0:1788666259.731041:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788666259.731050:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a096e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:633727f4-1aad-4438-919b-34cfb144e459+19:3276:x1875552186226560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788666259.731065:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666259.731085:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2a1d7d000/0x96bbe788361e99f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96bbe788361e99ee expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.731104:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666259.731190:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a096e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:633727f4-1aad-4438-919b-34cfb144e459+18:3276:x1875552186226560:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (2944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666259.731196:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788666259.731247:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788666259.731254:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1ab9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:633727f4-1aad-4438-919b-34cfb144e459+17:3277:x1875552186226688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788666259.731271:0:5793:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666259.731281:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab280031600/0x96bbe788361e991c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96bbe788361e9915 expref: 17 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.731313:0:5793:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666259.734343:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186226816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788666259.734429:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788666259.735897:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666259.735919:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186227072:0@lo:9:umount.0 00000100:00100000:0.0:1788666259.735980:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666259.736013:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186227200:0@lo:9:umount.0 00000100:00100000:0.0:1788666259.736034:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666259.736072:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186227072 00000100:00100000:0.0:1788666259.736080:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186227072 00000100:00100000:0.0:1788666259.736122:0:6651:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186227200 00000100:00100000:0.0:1788666259.736125:0:6651:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186227200 00000100:00100000:0.0:1788666259.736332:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788666259.736356:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3274:x1875552186227072:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788666259.736395:0:6651:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e986d 00000100:00080000:0.0:1788666259.736406:0:6651:0:(import.c:65:import_set_state_nolock()) ffff8ab2ae321000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788666259.736446:0:6651:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788666259.737077:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3274:x1875552186227072:12345-0@lo:9:umount.0 Request processed in 720us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666259.737086:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788666259.737106:0:6651:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788666259.737113:0:6651:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3274:x1875552186227200:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788666259.737128:0:6651:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e9946 00000100:00080000:0.0:1788666259.737136:0:6651:0:(import.c:65:import_set_state_nolock()) ffff8ab18119b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788666259.737312:0:6651:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788666259.737516:0:6651:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3274:x1875552186227200:12345-0@lo:9:umount.0 Request processed in 403us (1479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666259.737523:0:6651:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:0.0:1788666259.737555:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666259.737560:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788666259.737627:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab1811e0800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:1.0:1788666259.739273:0:7593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab298854800/0x96bbe788361e9c09 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x96bbe788361e9c10 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666259.739290:0:7593:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab298854800/0x96bbe788361e9c09 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x96bbe788361e9c10 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666259.739329:0:5794:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788666259.739340:0:5794:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788666259.739435:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666259.739438:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666259.739452:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666259.739473:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186226816 00000100:00100000:1.0:1788666259.739481:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186226816 00000100:00100000:1.0:1788666259.739601:0:12940:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788666259.739622:0:12940:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:633727f4-1aad-4438-919b-34cfb144e459+17:3278:x1875552186226816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788666259.739645:0:12940:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666259.739663:0:12940:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2b47f2000/0x96bbe788361e9c10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96bbe788361e9c09 expref: 17 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666259.739674:0:12940:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666259.739741:0:12940:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:633727f4-1aad-4438-919b-34cfb144e459+16:3278:x1875552186226816:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (5312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666259.739748:0:12940:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000004:00080000:0.0:1788666259.740960:0:3274:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788666259.740963:0:3274:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788666259.740971:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186227072:0@lo:9:umount.0 00000100:00080000:0.0:1788666259.741012:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab18119c800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788666259.741025:0:3274:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788666259.741027:0:3274:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788666259.741029:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186227200:0@lo:9:umount.0 00000100:00100000:0.0:1788666259.741082:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:633727f4-1aad-4438-919b-34cfb144e459:3278:1875552186226816:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788666259.741663:0:5803:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1788666259.741935:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2865e6000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788666259.741984:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2bfc18800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788666259.742005:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab2865e4000 for lustre-MDT0000 00000020:00000080:0.0:1788666259.742010:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab2bfc1e800 for lustre-MDT0000 00010000:00010000:0.0:1788666259.742024:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666259.744533:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1ab9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:633727f4-1aad-4438-919b-34cfb144e459+15:3277:x1875552186226688:12345-0@lo:103:ldlm_bl.0 Request processed in 13270us (16169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666259.744547:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788666259.744660:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186226560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788666259.744685:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788666259.744696:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186226944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788666259.744755:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666259.745016:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186226944 00000100:00100000:3.0:1788666259.745023:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186226944 00000100:00100000:3.0:1788666259.745072:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788666259.745081:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+15:3276:x1875552186226944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788666259.745095:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666259.745325:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2814fea00/0x96bbe788361e96d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96bbe788361e96c9 expref: 15 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666259.745345:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666259.745400:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:633727f4-1aad-4438-919b-34cfb144e459+14:3276:x1875552186226944:12345-0@lo:103:ldlm_bl.0 Request processed in 320us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666259.745407:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788666259.745490:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:633727f4-1aad-4438-919b-34cfb144e459:3276:1875552186226944:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788666259.746031:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:633727f4-1aad-4438-919b-34cfb144e459:3277:1875552186226688:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1788666259.750343:0:12939:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8ab2b48219c0) has no exports 00000020:00000080:3.0:1788666259.818236:0:12939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e9724 00000020:00000080:3.0:1788666259.818252:0:12939:0:(genops.c:885:class_export_put()) final put ffff8ab2bbe65800/lustre-QMT0000_UUID 00000020:01000000:3.0:1788666259.818281:0:12939:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788666259.818977:0:12939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788666259.818991:0:12939:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788666259.818996:0:12939:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8ab2989a0000) has no exports 00000020:00000080:0.0:1788666259.819381:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2bbe65800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788666259.819834:0:12939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e971d 00000020:00000080:0.0:1788666259.819844:0:12939:0:(genops.c:885:class_export_put()) final put ffff8ab2bcd5e000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788666259.819917:0:12939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788666259.819927:0:12939:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788666259.819930:0:12939:0:(genops.c:885:class_export_put()) final put ffff8ab2c109b000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788666259.819933:0:12939:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2c109b000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788666259.819937:0:12939:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788666259.821494:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2bcd5e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788666259.823272:0:12939:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab29810ff60 - data ffff8ab2a97efaf8/ffff8ab2ae73d000 00000020:01000000:0.0:1788666259.823436:0:12939:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab2a0ca2a20 - data ffff8ab28f414798/ffff8ab2a082cc00 00000001:00000004:2.0:1788666259.852003:0:12939:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1788666259.949291:0:12939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788666259.949303:0:12939:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1788666259.949327:0:12939:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788666259.949342:0:12939:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788666259.950889:0:6675:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788666259.950897:0:6675:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1788666259.950910:0:6675:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788666259.953974:0:12939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788666259.953981:0:12939:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1788666259.953999:0:12939:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788666259.954002:0:12939:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788666259.954720:0:7870:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788666259.954725:0:7870:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1788666259.954734:0:7870:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788666260.009736:0:12939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e96ec 00000020:00000080:3.0:1788666260.009747:0:12939:0:(genops.c:885:class_export_put()) final put ffff8ab2ae6d2000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788666260.010963:0:12939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e9701 00000020:00000080:3.0:1788666260.010971:0:12939:0:(genops.c:885:class_export_put()) final put ffff8ab2b4828800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788666260.010977:0:12939:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788666260.010982:0:12939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788666260.010990:0:12939:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788666260.010994:0:12939:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8ab2a0ca99c0) has no exports 00000004:01000000:3.0:1788666260.011149:0:12939:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788666260.011157:0:12939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e993f 00000020:00000080:3.0:1788666260.011161:0:12939:0:(genops.c:885:class_export_put()) final put ffff8ab2865e2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788666260.011165:0:12939:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788666260.011168:0:12939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788666260.011175:0:12939:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788666260.011178:0:12939:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8ab2b4820000) has no exports 00000020:00000080:3.0:1788666260.011183:0:12939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e9938 00000020:00000080:3.0:1788666260.011186:0:12939:0:(genops.c:885:class_export_put()) final put ffff8ab18119a000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788666260.011527:0:12939:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788666260.011531:0:12939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788666260.011535:0:12939:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1788666260.011541:0:12939:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788666260.011543:0:12939:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788666260.011570:0:12939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788666260.011577:0:12939:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788666260.011603:0:12939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e984a 00000020:00000080:3.0:1788666260.011607:0:12939:0:(genops.c:885:class_export_put()) final put ffff8ab1811e4800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788666260.011612:0:12939:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788666260.011616:0:12939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788666260.011620:0:12939:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788666260.011632:0:12939:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8ab2989a3380) has no exports 00000020:00000080:3.0:1788666260.011636:0:12939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e9843 00000020:00000080:3.0:1788666260.011639:0:12939:0:(genops.c:885:class_export_put()) final put ffff8ab1811e0000/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788666260.011970:0:12939:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788666260.011973:0:12939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788666260.011975:0:12939:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1788666260.011979:0:12939:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788666260.011981:0:12939:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788666260.012003:0:12939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788666260.012008:0:12939:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788666260.012035:0:12939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788666260.012039:0:12939:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788666260.012064:0:12939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e9708 00000020:00000080:3.0:1788666260.012068:0:12939:0:(genops.c:885:class_export_put()) final put ffff8ab2b4828000/lustre-MDD0000_UUID 00000020:01000000:3.0:1788666260.012071:0:12939:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788666260.012074:0:12939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788666260.012077:0:12939:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788666260.012080:0:12939:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8ab2b4823380) has no exports 00000020:00000080:3.0:1788666260.012097:0:12939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788666260.012101:0:12939:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788666260.012103:0:12939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e970f 00000020:00000080:3.0:1788666260.012107:0:12939:0:(genops.c:885:class_export_put()) final put ffff8ab2b482f800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788666260.012114:0:12939:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab290a54800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788666260.012117:0:12939:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab290a54800 3 00000020:01000004:3.0:1788666260.012120:0:12939:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ab290a54800 from lustre-MDT0000 00000020:00000080:3.0:1788666260.012138:0:12939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788666260.012141:0:12939:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788666260.012144:0:12939:0:(genops.c:885:class_export_put()) final put ffff8ab28632b800/lustre-MDT0000_UUID 00000020:00000080:3.0:1788666260.012147:0:12939:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab28632b800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788666260.012154:0:12939:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788666260.012214:0:12939:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1788666260.012218:0:12939:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788666260.012226:0:12939:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788666260.012229:0:12939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788666260.012232:0:12939:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788666260.012240:0:12939:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8ab2920cf800 633727f4-1aad-4438-919b-34cfb144e459 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788666260.012245:0:12939:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8ab2857b8000) has exports, disconnecting them 00000020:00080000:3.0:1788666260.012249:0:12939:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8ab2920cf800), last request at 1788666020 00000020:00000080:3.0:1788666260.012273:0:12939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e96ad 00000020:00010000:3.0:1788666260.012277:0:12939:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8ab2920cf800: total 8 00000100:00080000:3.0:1788666260.012281:0:12939:0:(import.c:65:import_set_state_nolock()) ffff8ab2920c8800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788666260.012297:0:12939:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab2920cf800): rc 0 00000020:00080000:3.0:1788666260.012300:0:12939:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8ab2857b8000) has no exports 00000100:00100000:3.0:1788666260.012374:0:5801:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8ab2a08e7800:5801] 1 exiting: rc = 0 00000100:00100000:3.0:1788666260.012454:0:5800:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8ab29053bc00:5800] 0 exiting: rc = 1 00000020:00000080:1.0:1788666260.012824:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2ae6d2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788666260.012837:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2b4828800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:1.0:1788666260.012842:0:38:0:(genops.c:885:class_export_put()) final put ffff8ab2b4215000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788666260.012844:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2b4215000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788666260.012847:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788666260.012964:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2865e2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788666260.012970:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab18119a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788666260.012975:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab18119c800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788666260.012979:0:38:0:(genops.c:885:class_export_put()) final put ffff8ab2865b8000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788666260.012989:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2865b8000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1788666260.012994:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788666260.013026:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab1811e4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788666260.013031:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab1811e0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788666260.013034:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab1811e0800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788666260.013038:0:38:0:(genops.c:885:class_export_put()) final put ffff8ab1811e2000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788666260.013040:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab1811e2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788666260.013043:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788666260.013100:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2b4828000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788666260.013104:0:38:0:(genops.c:885:class_export_put()) final put ffff8ab2a0d16000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788666260.013106:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2a0d16000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788666260.013109:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788666260.013276:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2b482f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1788666260.013386:0:5796:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8ab2920cf800: total 0 00010000:00010000:0.0:1788666260.013415:0:5796:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8ab2920cf800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788666260.013442:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab280031800/0x96bbe788361e99bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96bbe788361e99b6 expref: 9 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666260.013459:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab280030600/0x96bbe788361e99af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96bbe788361e99a8 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666260.013469:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab280031200/0x96bbe788361e99cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96bbe788361e99c4 expref: 7 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666260.013479:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab283fd4800/0x96bbe788361e99d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96bbe788361e99d2 expref: 6 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666260.013499:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2814fe800/0x96bbe788361e9c02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96bbe788361e9bfb expref: 5 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666260.013509:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab283fd5000/0x96bbe788361e97b7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96bbe788361e97b0 expref: 4 pid: 5801 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666260.013522:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2b47f3200/0x96bbe788361e9bf4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96bbe788361e9bed expref: 3 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666260.013535:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab283fd5400/0x96bbe788361e9a03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x96bbe788361e99fc expref: 2 pid: 5800 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666260.013544:0:5796:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8ab2920cf800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1788666260.013556:0:5796:0:(genops.c:885:class_export_put()) final put ffff8ab2920cf800/633727f4-1aad-4438-919b-34cfb144e459 00010000:00010000:0.0:1788666260.013575:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666260.013597:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666260.013599:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788666260.013752:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2920cf800/633727f4-1aad-4438-919b-34cfb144e459 for MGS 00000020:00000080:1.0:1788666260.013788:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab2920c8800 for MGS 00000100:00100000:2.0:1788666260.013915:0:5802:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8ab2904cc800:5802] 2 exiting: rc = 0 00000100:00100000:3.0:1788666260.014341:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014349:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014357:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014364:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014369:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014375:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014380:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014386:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014392:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014398:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014405:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014410:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014416:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014422:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014427:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014432:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014438:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014444:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014449:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014454:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014469:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014475:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014481:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014486:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014492:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014498:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014504:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014510:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014515:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014521:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014526:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014531:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014536:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014542:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014547:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014552:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014558:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014562:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014568:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014573:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014613:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014620:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014842:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014851:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014857:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014862:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014867:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014873:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014879:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014884:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014889:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014895:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014900:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014905:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014910:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014924:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014930:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014936:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014942:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014948:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014954:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014960:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014966:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.014971:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788666260.015445:0:12939:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788666260.015449:0:12939:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1788666260.017438:0:12939:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab29810fc00 - data ffff8ab2bff29e58/ffff8ab2ae73e800 00000020:01000000:3.0:1788666260.017559:0:12939:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab2a09e9840 - data ffff8ab28f453bd0/ffff8ab28561e000 00000020:00000080:3.0:1788666260.018218:0:12939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e9691 00000020:00000080:3.0:1788666260.018226:0:12939:0:(genops.c:885:class_export_put()) final put ffff8ab29aa86800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788666260.018251:0:12939:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab290a54800 from MGS, refs=2 00000020:01000004:3.0:1788666260.018263:0:12939:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab290a54800 2 00000020:01000004:3.0:1788666260.018267:0:12939:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ab290a54800 from MGS 00000020:00000080:3.0:1788666260.018286:0:12939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788666260.018291:0:12939:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788666260.018294:0:12939:0:(genops.c:885:class_export_put()) final put ffff8ab29aa80000/MGS 00000020:00000080:3.0:1788666260.018296:0:12939:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab29aa80000/MGS for MGS 00000020:01000000:3.0:1788666260.018302:0:12939:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788666260.018351:0:12939:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788666260.018354:0:12939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788666260.018359:0:12939:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788666260.018367:0:12939:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8ab2b4221800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788666260.018372:0:12939:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8ab2857b99c0) has exports, disconnecting them 00000020:00080000:3.0:1788666260.018377:0:12939:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8ab2b4221800), last request at 1788666021 00000020:00000080:3.0:1788666260.018380:0:12939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e975c 00000020:00080000:3.0:1788666260.018388:0:12939:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab2b4221800): rc 0 00000020:00000080:3.0:1788666260.018392:0:12939:0:(genops.c:885:class_export_put()) final put ffff8ab2b4221800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788666260.018789:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab29aa86800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788666260.018799:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2b4221800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788666260.038832:0:12939:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788666260.038841:0:12939:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788666260.038846:0:12939:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788666260.038854:0:12939:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788666260.039054:0:12939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788666260.039063:0:12939:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788666260.039070:0:12939:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab290a54800 1 00000020:00000080:0.0:1788666260.039079:0:12939:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e9683 00000020:00000080:0.0:1788666260.039089:0:12939:0:(genops.c:885:class_export_put()) final put ffff8ab29aa85000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788666260.039094:0:12939:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788666260.039100:0:12939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788666260.039104:0:12939:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788666260.039108:0:12939:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8ab2a0cacd40) has no exports 00000020:00000080:1.0:1788666260.039480:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab2b4223000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788666260.039487:0:467:0:(genops.c:885:class_export_put()) final put ffff8ab2b4225800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1788666260.039490:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2b4225800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1788666260.039499:0:467:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1788666260.039555:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab29aa85000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788666260.127995:0:12939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788666260.128011:0:12939:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788666260.128017:0:12939:0:(genops.c:885:class_export_put()) final put ffff8ab290a53000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788666260.128021:0:12939:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab290a53000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788666260.128028:0:12939:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788666260.128187:0:12939:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ab290a56000 00000020:01000000:1.0:1788666260.128209:0:12939:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788666260.128215:0:12939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788666260.128220:0:12939:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788666260.128224:0:12939:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8ab2a0ca8000) has no exports 00000100:00100000:0.0:1788666260.128361:0:5810:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8ab29053b600:5810] 2 exiting: rc = 0 00000100:00100000:2.0:1788666260.129446:0:5808:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8ab2905e1200:5808] 0 exiting: rc = 1 00000100:00100000:2.0:1788666260.129747:0:5809:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8ab29053b800:5809] 1 exiting: rc = 0 00000100:00100000:3.0:1788666260.133551:0:12001:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8ab2c1a80c00:12001] 4 exiting: rc = 0 00000100:00100000:3.0:1788666260.133986:0:7132:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8ab2ae291400:7132] 3 exiting: rc = 0 00000100:00100000:1.0:1788666260.134421:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134430:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134435:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134440:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134445:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134456:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134465:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134470:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134475:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134481:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134495:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134500:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134505:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134511:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134516:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134521:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134526:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134531:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134536:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134549:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134563:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134568:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134574:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134594:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134620:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134698:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134721:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134728:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134735:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134741:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134758:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134764:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134770:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134775:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134781:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134787:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134793:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134799:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134805:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134811:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134817:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134822:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134828:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134833:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134840:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134845:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134852:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134857:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134863:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134868:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134874:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134879:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134884:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134890:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134896:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134901:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134907:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134913:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134919:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134925:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134931:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134936:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134942:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.134947:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.139069:0:5812:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8ab286543600:5812] 1 exiting: rc = 0 00000100:00100000:3.0:1788666260.139353:0:11980:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff8ab286246800:11980] 2 exiting: rc = 0 00000100:00100000:0.0:1788666260.139804:0:5811:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8ab286542e00:5811] 0 exiting: rc = 1 00000100:00100000:1.0:1788666260.139915:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.139941:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.139947:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.139954:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.139961:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.139967:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.139973:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.139978:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.139985:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.139991:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.139996:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140002:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140009:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140015:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140021:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140026:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140031:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140036:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140042:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140047:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140052:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140057:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140062:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140067:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140072:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140077:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140083:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140088:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140093:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140098:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140103:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140109:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140113:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140118:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140124:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140129:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140143:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140148:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140153:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140158:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140163:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140168:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140173:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140178:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140183:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140188:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140194:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140199:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140204:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140209:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140214:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140220:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140224:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140229:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140234:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140240:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140245:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140261:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140268:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140275:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140281:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140286:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140292:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.140297:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.141009:0:5813:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8ab2a0d38600:5813] 0 exiting: rc = 1 00000100:00100000:0.0:1788666260.141101:0:5814:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8ab2a0d38200:5814] 1 exiting: rc = 0 00000100:00100000:1.0:1788666260.141217:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141226:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141232:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141238:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141244:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141263:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141271:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141286:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141293:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141299:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141315:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141322:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141328:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141334:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141341:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141347:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141353:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141359:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141366:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141372:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141379:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141385:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141404:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141411:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141419:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141426:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141433:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141439:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141445:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141451:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141457:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141464:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141470:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141475:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141497:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141504:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141510:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141516:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141524:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141529:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141535:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141541:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141555:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141561:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141567:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141574:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141820:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141827:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141833:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141839:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141846:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141858:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141911:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141918:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141925:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141931:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141937:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141944:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141965:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141972:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141978:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141984:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.141990:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.142005:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.152392:0:5815:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8ab2a0d35a00:5815] 0 exiting: rc = 1 00000100:00100000:3.0:1788666260.152526:0:5816:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8ab2989c6000:5816] 1 exiting: rc = 0 00000100:00100000:0.0:1788666260.152788:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152795:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152800:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152805:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152809:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152814:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152819:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152823:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152828:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152833:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152837:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152849:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152854:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152944:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152949:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152954:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152960:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152966:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152971:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152976:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152982:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152987:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152992:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.152998:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153004:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153009:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153014:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153019:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153024:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153030:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153049:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153055:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153060:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153064:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153070:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153076:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153082:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153087:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153091:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153097:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153102:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153107:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153111:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153117:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153122:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153126:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153131:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153135:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153140:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153145:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153150:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153155:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153161:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153166:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153171:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153175:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153180:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153184:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153189:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153194:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153199:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153203:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153208:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.153214:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788666260.154040:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8ab2a0d30e00:5818] 1 exiting: rc = 0 00000100:00100000:0.0:1788666260.154181:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8ab2a0d31400:5817] 0 exiting: rc = 1 00000100:00100000:1.0:1788666260.154267:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154274:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154280:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154285:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154291:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154296:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154301:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154306:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154311:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154316:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154322:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154327:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154342:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154347:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154352:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154357:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154362:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154367:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154373:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154378:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154383:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154389:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154394:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154399:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154403:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154408:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154413:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154419:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154424:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154429:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154434:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154440:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154445:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154450:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154457:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154462:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154468:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154473:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154479:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154484:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154489:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154495:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154500:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154505:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154510:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154515:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154519:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154533:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154538:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154543:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154548:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154553:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154559:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154564:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154568:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154573:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154785:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154792:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154797:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154801:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154806:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154811:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154816:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.154821:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.155536:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8ab2a0d30800:5819] 0 exiting: rc = 1 00000100:00100000:3.0:1788666260.155825:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8ab2a0d30600:5820] 1 exiting: rc = 0 00000100:00100000:1.0:1788666260.155936:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.155943:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.155949:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.155953:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.155958:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.155963:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.155968:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.155974:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.155980:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.155985:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.155990:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.155994:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156000:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156005:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156010:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156015:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156020:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156025:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156041:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156046:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156051:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156056:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156061:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156066:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156071:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156076:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156081:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156086:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156090:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156095:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156101:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156106:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156111:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156116:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156121:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156126:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156130:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156136:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156141:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156146:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156151:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156156:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156161:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156166:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156170:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156175:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156180:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156185:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156191:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156195:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156201:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156206:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156211:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156225:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156230:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156234:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156239:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156244:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156249:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156264:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156269:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156274:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156280:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.156285:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666260.157027:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8ab286255200:5821] 0 exiting: rc = 1 00000100:00100000:3.0:1788666260.157220:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8ab2a0d26a00:5822] 1 exiting: rc = 0 00000100:00100000:2.0:1788666260.157389:0:5823:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8ab2a0d26c00:5823] 2 exiting: rc = 0 00000100:00100000:1.0:1788666260.157770:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157778:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157784:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157793:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157807:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157812:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157820:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157825:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157830:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157835:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157844:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157849:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157854:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157860:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157865:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157870:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157875:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157881:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157899:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157905:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157913:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157918:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157923:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157928:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157942:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157947:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157953:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157958:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157963:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157968:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157973:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157979:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157983:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157989:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157993:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.157998:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158003:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158007:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158013:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158018:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158023:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158027:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158042:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158048:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158052:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158057:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158062:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158068:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158073:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158079:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158085:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158090:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158097:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158102:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158109:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158115:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158121:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158127:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158133:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158147:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158152:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158157:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158164:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666260.158168:0:12939:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788666260.167535:0:12939:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788666260.167548:0:12939:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788666260.167553:0:12939:0:(genops.c:885:class_export_put()) final put ffff8ab28632d800/MDS_uuid 00000020:00000080:1.0:1788666260.167557:0:12939:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab28632d800/MDS_uuid for MDS 00000020:01000000:1.0:1788666260.167563:0:12939:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788666260.167779:0:12939:0:(tgt_mount.c:2186:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788666260.490924:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788666261.504997:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788666261.505006:0:7606:0:(genops.c:885:class_export_put()) final put ffff8ab18119b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788666261.505162:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab18119b000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788666261.505209:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab18119b800 for lustre-OST0001 00010000:00010000:1.0:1788666261.516546:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666261.900753:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3278:1875552186227584:0@lo:400:kworker.0 00000400:00000100:0.0:1788666261.900808:0:3278:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875552186227584 offset 0 length 224: 4 00000100:00100000:0.0:1788666261.900858:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788666261.900865:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186227456:0@lo:400:kworker.0 00000400:00000100:0.0:1788666261.900884:0:3278:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875552186227456 offset 0 length 224: 4 00000100:00100000:3.0:1788666261.900975:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788666261.900985:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186227328:0@lo:400:kworker.0 00000400:00000100:3.0:1788666261.901010:0:3275:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875552186227328 offset 0 length 224: 4 00010000:00010000:0.0:1788666262.540105:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788666263.535347:0:13090:0:(tgt_mount.c:2197:server_umount_begin()) umount -f 00000020:01000004:1.0:1788666263.552969:0:13090:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788666263.553019:0:13090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe000/0x96bbe788361e99c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666263.553036:0:13090:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe000/0x96bbe788361e99c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e99cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666263.553043:0:13090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe000/0x96bbe788361e99c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x96bbe788361e99cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666263.553051:0:13090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe000/0x96bbe788361e99c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x96bbe788361e99cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666263.553071:0:13090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788666263.553076:0:13090:0:(mgc_request.c:545:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788666263.553250:0:13090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788666263.553263:0:13090:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab2b480ce00 x1875552186227456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666277 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666263.553346:0:13090:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788666263.553353:0:13090:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788666263.553382:0:13090:0:(import.c:65:import_set_state_nolock()) ffff8ab1811f6800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788666263.553465:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3274:1875552186227712:0@lo:39:umount.0 00000400:00000100:3.0:1788666263.553521:0:3274:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875552186227712 offset 0 length 224: 4 00010000:00010000:0.0:1788666263.553799:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666263.553807:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe000/0x96bbe788361e99c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x96bbe788361e99cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666263.553816:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2814fe000 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:0.0:1788666263.553820:0:5796:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe000/0x96bbe788361e99c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x96bbe788361e99cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666263.553829:0:5796:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe000/0x96bbe788361e99c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x96bbe788361e99cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788666263.553836:0:5796:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe000/0x96bbe788361e99c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x96bbe788361e99cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666263.553842:0:5796:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788666263.553845:0:5796:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788666263.553847:0:5796:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788666263.553875:0:5796:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe000/0x96bbe788361e99c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x96bbe788361e99cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666263.553889:0:5796:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788666263.553907:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe000/0x96bbe788361e99c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x96bbe788361e99cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666263.553914:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab2814fe000/0x96bbe788361e99c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x96bbe788361e99cb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666263.553924:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666263.553925:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666263.553927:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666263.554242:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186227840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788666263.554288:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666263.554336:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186227840 00000100:00100000:3.0:1788666263.554345:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186227840 00000100:00100000:3.0:1788666263.554381:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788666263.554388:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3275:x1875552186227840:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788666263.554395:0:5794:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788666263 with bad export cookie 10861529498543625901 00000100:00100000:2.0:1788666263.558806:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186227456:0@lo:400:kworker.0 00000100:00100000:2.0:1788666263.562711:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3275:x1875552186227840:12345-0@lo:103:ldlm_bl.0 Request processed in 8313us (8414us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788666263.562727:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1788666263.562982:0:3275:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.125@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788666263.562988:0:3275:0:(import.c:65:import_set_state_nolock()) ffff8ab298996000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788666263.562991:0:3275:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1788666263.568916:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788666263.571285:0:3275:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.125@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788666263.571290:0:3275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788666263.571301:0:3275:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab2b480c000 x1875552186227328/t0(0) o400->MGC192.168.201.125@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788666277 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666263.571336:0:3275:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab2b480df80 x1875552186227840/t0(0) o103->MGC192.168.201.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788666279 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788666263.571344:0:3275:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788666263.571347:0:3275:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788666263.571348:0:3275:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788666263.571352:0:3275:0:(import.c:65:import_set_state_nolock()) ffff8ab298996000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788666263.571357:0:3275:0:(import.c:545:import_select_connection()) MGC192.168.201.125@tcp: connect to NID 0@lo last attempt 127 00000100:00080000:3.0:1788666263.571367:0:3275:0:(import.c:665:import_select_connection()) MGC192.168.201.125@tcp: import ffff8ab298996000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:2.0:1788666263.571486:0:3275:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab2c1abb800 x1875552186227968/t0(0) o250->MGC192.168.201.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788666263.571552:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:633727f4-1aad-4438-919b-34cfb144e459:3274:1875552186227968:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:3.0:1788666263.571647:0:3274:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875552186227968 offset 0 length 520: 4 00000100:00100000:2.0:1788666263.571970:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186227328:0@lo:400:kworker.0 00000100:00100000:2.0:1788666263.571998:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:633727f4-1aad-4438-919b-34cfb144e459:3275:1875552186227840:0@lo:103:ldlm_bl.0 00000001:00100000:1.0:1788666264.025862:0:6678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788666264.025873:0:6678:0:(genops.c:885:class_export_put()) final put ffff8ab2ae321800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788666264.025963:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2ae321800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788666264.026016:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab2ae321000 for lustre-OST0000 00010000:00010000:1.0:1788666264.586753:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666265.610776:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666266.634799:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788666267.019103:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) 633727f4-1aad-4438-919b-34cfb144e459->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788666267.019113:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) 633727f4-1aad-4438-919b-34cfb144e459->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788666267.019235:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788666267.019257:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186228096:0@lo:400:kworker.0 00000400:00000100:2.0:1788666267.019309:0:3275:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875552186228096 offset 0 length 224: 4 00010000:00010000:0.0:1788666267.659635:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666268.682757:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788666269.066999:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 633727f4-1aad-4438-919b-34cfb144e459->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788666269.067010:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 633727f4-1aad-4438-919b-34cfb144e459->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788666269.067253:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3277:1875552186228224:0@lo:400:kworker.0 00000400:00000100:1.0:1788666269.067312:0:3277:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875552186228224 offset 0 length 224: 4 00010000:00010000:0.0:1788666269.706896:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666270.732740:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666271.757227:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666272.778720:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666273.162948:0:3274:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788666263/real 1788666263] req@ffff8ab2c1abb800 x1875552186227968/t0(0) o250->MGC192.168.201.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788666273 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666273.162986:0:3274:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab2c1abb800 x1875552186227968/t0(0) o250->MGC192.168.201.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788666273 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666273.162998:0:3274:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788666263/real 1788666263] req@ffff8ab2ae97ad80 x1875552186227712/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788666273 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666273.163009:0:3274:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab2ae97ad80 x1875552186227712/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788666273 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788666273.163067:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab298996000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788666273.163092:0:3274:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1788666273.163096:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1abb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:633727f4-1aad-4438-919b-34cfb144e459:3274:1875552186227968:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:3.0:1788666273.163102:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab1811f6800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788666273.163114:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3274:1875552186227712:0@lo:39:umount.0 00000100:00080000:0.0:1788666273.163201:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 633727f4-1aad-4438-919b-34cfb144e459->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788666273.163206:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788666273.163209:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab298996000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788666273.163214:0:38:0:(import.c:545:import_select_connection()) MGC192.168.201.125@tcp: connect to NID 0@lo last attempt 370 00000100:00080000:0.0:1788666273.163220:0:38:0:(import.c:630:import_select_connection()) MGC192.168.201.125@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788666273.163227:0:38:0:(import.c:665:import_select_connection()) MGC192.168.201.125@tcp: import ffff8ab298996000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1788666273.163276:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab2b480d500 x1875552186228352/t0(0) o250->MGC192.168.201.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788666273.163485:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3278:1875552186228480:0@lo:400:kworker.0 00000400:00000100:2.0:1788666273.163535:0:3278:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875552186228480 offset 0 length 224: 4 00000100:00100000:3.0:1788666273.163686:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:633727f4-1aad-4438-919b-34cfb144e459:3274:1875552186228352:0@lo:250:kworker.0 00000400:00000100:3.0:1788666273.163715:0:3274:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875552186228352 offset 0 length 520: 4 00000100:00080000:1.0:1788666273.163824:0:13090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788666273.163829:0:13090:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788666273.163834:0:13090:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788666273.164881:0:13090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e99d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99d9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666273.164893:0:13090:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e99d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e99d9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666273.164898:0:13090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e99d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96bbe788361e99d9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666273.164902:0:13090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e99d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x96bbe788361e99d9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666273.164966:0:13090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788666273.164972:0:13090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab28144a000/0x96bbe788361e9bfb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9c02 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666273.164977:0:13090:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab28144a000/0x96bbe788361e9bfb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9c02 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666273.164981:0:13090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab28144a000/0x96bbe788361e9bfb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96bbe788361e9c02 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666273.164984:0:13090:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff8ab28144a000/0x96bbe788361e9bfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96bbe788361e9c02 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666273.165109:0:7594:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788666273.165117:0:7594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e99d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96bbe788361e99d9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666273.165126:0:7594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab280030000 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:0.0:1788666273.165131:0:7594:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e99d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x96bbe788361e99d9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666273.165212:0:7594:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e99d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x96bbe788361e99d9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788666273.165220:0:7594:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e99d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x96bbe788361e99d9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666273.165226:0:7594:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788666273.165229:0:7594:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:0.0:1788666273.165239:0:7594:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab298996000 00010000:00010000:0.0:1788666273.165242:0:7594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e99d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x96bbe788361e99d9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666273.165249:0:7594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab280030000/0x96bbe788361e99d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x96bbe788361e99d9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666273.165264:0:7594:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666273.165268:0:7594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab28144a000/0x96bbe788361e9bfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96bbe788361e9c02 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666273.165274:0:7594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144a000 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:0.0:1788666273.165283:0:7594:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab28144a000/0x96bbe788361e9bfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96bbe788361e9c02 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666273.165290:0:7594:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab28144a000/0x96bbe788361e9bfb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96bbe788361e9c02 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788666273.165297:0:7594:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab28144a000/0x96bbe788361e9bfb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96bbe788361e9c02 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666273.165302:0:7594:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788666273.165304:0:7594:0:(mgc_request.c:942:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788666273.165308:0:7594:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab298996000 00010000:00010000:0.0:1788666273.165311:0:7594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab28144a000/0x96bbe788361e9bfb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x96bbe788361e9c02 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666273.165317:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666273.165318:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666273.165320:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666273.165353:0:13090:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788666273.165357:0:13090:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab28144a000/0x96bbe788361e9bfb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x96bbe788361e9c02 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666273.165366:0:13090:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1788666273.165370:0:13090:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1788666273.165372:0:13090:0:(mgc_request.c:545:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788666273.165392:0:13090:0:(tgt_mount.c:2117:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788666273.165396:0:13090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788666273.165400:0:13090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788666273.165406:0:13090:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788666273.165410:0:13090:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8ab2857bcd40) has no exports 00000020:00080000:1.0:1788666273.165432:0:13090:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8ab2857bcd40) has no exports 00010000:00010000:0.0:1788666273.166326:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788666273.168398:0:13090:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab29810f300 - data ffff8ab28f75b510/ffff8ab2bc25e400 00000020:01000000:1.0:1788666273.168527:0:13090:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab181125660 - data ffff8ab28f60b360/ffff8ab181377800 00100000:10000000:1.0:1788666273.181066:0:13090:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788666273.197683:0:13090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e97d3 00000020:00000080:0.0:1788666273.197698:0:13090:0:(genops.c:885:class_export_put()) final put ffff8ab2bfc1c800/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788666273.197752:0:13090:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab2bcd59800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788666273.197756:0:13090:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab2bcd59800 2 00000020:01000004:0.0:1788666273.197760:0:13090:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ab2bcd59800 from lustre-OST0000 00000020:00000080:0.0:1788666273.197789:0:13090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788666273.197801:0:13090:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788666273.197804:0:13090:0:(genops.c:885:class_export_put()) final put ffff8ab2ae6d7000/lustre-OST0000_UUID 00000020:00000080:0.0:1788666273.197806:0:13090:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2ae6d7000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788666273.197816:0:13090:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788666273.197901:0:13090:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788666273.197907:0:13090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788666273.197912:0:13090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788666273.197931:0:13090:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788666273.197940:0:13090:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8ab1811f3800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788666273.197946:0:13090:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8ab2a0cab380) has exports, disconnecting them 00000020:00080000:0.0:1788666273.197952:0:13090:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8ab1811f3800), last request at 1788666037 00000020:00000080:0.0:1788666273.197957:0:13090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e97fd 00000020:00080000:0.0:1788666273.197966:0:13090:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab1811f3800): rc 0 00000020:00000080:0.0:1788666273.197972:0:13090:0:(genops.c:885:class_export_put()) final put ffff8ab1811f3800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788666273.198000:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2bfc1c800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788666273.198932:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab1811f3800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788666273.201646:0:13090:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788666273.201654:0:13090:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788666273.201658:0:13090:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788666273.201667:0:13090:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788666273.201964:0:13090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788666273.201974:0:13090:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788666273.201981:0:13090:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab2bcd59800 1 00000020:00000080:2.0:1788666273.201988:0:13090:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e978d 00000020:00000080:2.0:1788666273.201997:0:13090:0:(genops.c:885:class_export_put()) final put ffff8ab2ae6d6800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788666273.202035:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab1811f6800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788666273.202042:0:38:0:(genops.c:885:class_export_put()) final put ffff8ab2bbf63000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788666273.202048:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2bbf63000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788666273.202078:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788666273.202245:0:13090:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788666273.202251:0:13090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788666273.202255:0:13090:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788666273.202259:0:13090:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8ab2989a19c0) has no exports 00000020:00000080:3.0:1788666273.202476:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2ae6d6800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788666273.213342:0:13090:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788666273.213360:0:13090:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788666273.213366:0:13090:0:(genops.c:885:class_export_put()) final put ffff8ab2bcd5c000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788666273.213371:0:13090:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2bcd5c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788666273.213388:0:13090:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788666273.213508:0:13090:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ab2bcd5a800 00000020:02000400:3.0:1788666273.213552:0:13090:0:(tgt_mount.c:2186:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788666273.802780:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666274.827663:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788666275.239524:0:13242:0:(tgt_mount.c:2197:server_umount_begin()) umount -f 00000020:01000004:1.0:1788666275.255807:0:13242:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788666275.255888:0:13242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4400/0x96bbe788361e99a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666275.255905:0:13242:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4400/0x96bbe788361e99a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e99af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666275.255912:0:13242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4400/0x96bbe788361e99a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x96bbe788361e99af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666275.255919:0:13242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4400/0x96bbe788361e99a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x96bbe788361e99af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666275.255977:0:13242:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788666275.255982:0:13242:0:(mgc_request.c:545:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788666275.256018:0:13242:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788666275.256029:0:13242:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab2b480f480 x1875552186227584/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666277 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666275.256051:0:13242:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab2ae979880 x1875552186228096/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666283 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666275.256068:0:13242:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab2b480e680 x1875552186228224/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666285 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666275.256082:0:13242:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab2b480df80 x1875552186228480/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666289 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666275.256089:0:13242:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788666275.256095:0:13242:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788666275.256119:0:13242:0:(import.c:65:import_set_state_nolock()) ffff8ab2bbe64800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788666275.256258:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186228096:0@lo:400:kworker.0 00000100:00100000:2.0:1788666275.256304:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3277:1875552186228224:0@lo:400:kworker.0 00000100:00100000:3.0:1788666275.256525:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3278:1875552186228480:0@lo:400:kworker.0 00000100:00100000:3.0:1788666275.256534:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3278:1875552186227584:0@lo:400:kworker.0 00000100:00100000:3.0:1788666275.256561:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae978700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3274:1875552186228608:0@lo:39:umount.0 00000400:00000100:3.0:1788666275.256639:0:3274:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875552186228608 offset 0 length 224: 4 00010000:00010000:0.0:1788666275.256826:0:7594:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666275.256835:0:7594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4400/0x96bbe788361e99a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x96bbe788361e99af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666275.256843:0:7594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4400 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:0.0:1788666275.256846:0:7594:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4400/0x96bbe788361e99a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x96bbe788361e99af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666275.256855:0:7594:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4400/0x96bbe788361e99a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x96bbe788361e99af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788666275.256863:0:7594:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4400/0x96bbe788361e99a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x96bbe788361e99af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666275.256869:0:7594:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788666275.256872:0:7594:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788666275.256874:0:7594:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788666275.256889:0:7594:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab298996000 00010000:00010000:0.0:1788666275.256893:0:7594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4400/0x96bbe788361e99a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x96bbe788361e99af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666275.256900:0:7594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab283fd4400/0x96bbe788361e99a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x96bbe788361e99af expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666275.256921:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666275.256922:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666275.256924:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666275.850891:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666276.875025:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666277.899289:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788666278.282757:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) 633727f4-1aad-4438-919b-34cfb144e459->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788666278.282769:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) 633727f4-1aad-4438-919b-34cfb144e459->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788666278.922736:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666279.950667:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666280.975388:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666281.995323:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666283.019035:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788666283.405281:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) 633727f4-1aad-4438-919b-34cfb144e459->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788666283.405291:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) 633727f4-1aad-4438-919b-34cfb144e459->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788666284.042895:0:5796:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666285.066758:0:5797:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666285.450783:0:3274:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788666275/real 1788666275] req@ffff8ab2ae978700 x1875552186228608/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788666285 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666285.450827:0:3274:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab2ae978700 x1875552186228608/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788666285 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788666285.450847:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab2bbe64800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788666285.450872:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae978700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3274:1875552186228608:0@lo:39:umount.0 00000100:00080000:3.0:1788666285.450970:0:13242:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788666285.450975:0:13242:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788666285.450979:0:13242:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788666285.452298:0:13242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e99b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e99bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666285.452314:0:13242:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e99b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e99bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666285.452335:0:13242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e99b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96bbe788361e99bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666285.452343:0:13242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e99b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x96bbe788361e99bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666285.452369:0:13242:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788666285.453617:0:7593:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666285.453627:0:7593:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e99b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96bbe788361e99bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666285.453636:0:7593:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd5c00 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:1.0:1788666285.453640:0:7593:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e99b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x96bbe788361e99bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666285.453650:0:7593:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e99b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x96bbe788361e99bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666285.453657:0:7593:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e99b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x96bbe788361e99bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666285.453663:0:7593:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788666285.453666:0:7593:0:(mgc_request.c:942:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1788666285.453678:0:7593:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab298996000 00010000:00010000:1.0:1788666285.453682:0:7593:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e99b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x96bbe788361e99bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666285.453707:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666285.453709:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666285.453711:0:7593:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666285.453851:0:13242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5c00/0x96bbe788361e99b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x96bbe788361e99bd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666285.453870:0:13242:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9bed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361e9bf4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666285.453877:0:13242:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9bed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361e9bf4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666285.453884:0:13242:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9bed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x96bbe788361e9bf4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666285.453891:0:13242:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9bed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x96bbe788361e9bf4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666285.453947:0:13242:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788666285.453953:0:13242:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788666285.453957:0:13242:0:(mgc_request.c:545:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788666285.453985:0:13242:0:(tgt_mount.c:2117:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788666285.453989:0:13242:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788666285.453995:0:13242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788666285.454002:0:13242:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788666285.454011:0:13242:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8ab2b44e3380) has no exports 00000020:00080000:3.0:1788666285.454035:0:13242:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8ab2b44e3380) has no exports 00010000:00010000:0.0:1788666285.458488:0:7594:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666285.458503:0:7594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9bed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x96bbe788361e9bf4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666285.458514:0:7594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab28144b200 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:0.0:1788666285.458519:0:7594:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9bed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x96bbe788361e9bf4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666285.458528:0:7594:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9bed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x96bbe788361e9bf4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788666285.458537:0:7594:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9bed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x96bbe788361e9bf4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788666285.458543:0:7594:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788666285.458561:0:7594:0:(mgc_request.c:942:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788666285.458564:0:7594:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788666285.458595:0:7594:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab298996000 00010000:00010000:0.0:1788666285.458600:0:7594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9bed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x96bbe788361e9bf4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666285.458608:0:7594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab28144b200/0x96bbe788361e9bed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x96bbe788361e9bf4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666285.458682:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666285.458684:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666285.458686:0:7594:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788666285.458863:0:13242:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab29810f5a0 - data ffff8ab28f75b288/ffff8ab2bc2e6400 00000020:01000000:3.0:1788666285.459002:0:13242:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8ab2831b66c0 - data ffff8ab2a9703e58/ffff8ab2c19b8800 00100000:10000000:3.0:1788666285.473049:0:13242:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788666285.497098:0:13242:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e98ac 00000020:00000080:2.0:1788666285.497107:0:13242:0:(genops.c:885:class_export_put()) final put ffff8ab2b44d9000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788666285.497128:0:13242:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab2bbf65000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788666285.497133:0:13242:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab2bbf65000 2 00000020:01000004:2.0:1788666285.497136:0:13242:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8ab2bbf65000 from lustre-OST0001 00000020:00000080:2.0:1788666285.497163:0:13242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788666285.497181:0:13242:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788666285.497183:0:13242:0:(genops.c:885:class_export_put()) final put ffff8ab2b44dc800/lustre-OST0001_UUID 00000020:00000080:2.0:1788666285.497186:0:13242:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2b44dc800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788666285.497192:0:13242:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788666285.497293:0:13242:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 633727f4-1aad-4438-919b-34cfb144e459->MGS 00010000:00010000:2.0:1788666285.497307:0:13242:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5a00/0x96bbe788361e97b0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x96bbe788361e97b7 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788666285.497330:0:13242:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5a00/0x96bbe788361e97b0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x96bbe788361e97b7 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666285.497337:0:13242:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788666285.497340:0:13242:0:(mgc_request.c:952:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788666285.497343:0:13242:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788666285.497365:0:13242:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab298996000 00010000:00010000:2.0:1788666285.497369:0:13242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab283fd5a00/0x96bbe788361e97b0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x96bbe788361e97b7 expref: -99 pid: 6646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666285.497824:0:13242:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab280031400/0x96bbe788361e99fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x96bbe788361e9a03 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788666285.497834:0:13242:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab280031400/0x96bbe788361e99fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x96bbe788361e9a03 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666285.497839:0:13242:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788666285.497842:0:13242:0:(mgc_request.c:952:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788666285.497844:0:13242:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1788666285.497853:0:13242:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8ab298996000 00010000:00010000:2.0:1788666285.497856:0:13242:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab280031400/0x96bbe788361e99fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x96bbe788361e9a03 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788666285.497872:0:13242:0:(import.c:65:import_set_state_nolock()) ffff8ab298996000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788666285.497875:0:13242:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788666285.497878:0:13242:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788666285.497879:0:13242:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788666285.497883:0:13242:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788666285.497893:0:13242:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8ab2b480d500 x1875552186228352/t0(0) o250->MGC192.168.201.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788666288 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788666285.497919:0:13242:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788666285.497922:0:13242:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000020:00000080:1.0:1788666285.498093:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2b44d9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:1.0:1788666285.498129:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:633727f4-1aad-4438-919b-34cfb144e459:3274:1875552186228352:0@lo:250:kworker.0 10000000:01000000:2.0:1788666285.499315:0:13242:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788666285.499327:0:13242:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e969f 00000020:00000080:2.0:1788666285.499335:0:13242:0:(genops.c:885:class_export_put()) final put ffff8ab28632d000/633727f4-1aad-4438-919b-34cfb144e459 00000020:01000000:2.0:1788666285.499358:0:13242:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.125@tcp (flags='') 00000020:00000080:2.0:1788666285.499365:0:13242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788666285.499371:0:13242:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.125@tcp: forcing exports to disconnect: 0/3 00000020:00000080:1.0:1788666285.499487:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab28632d000/633727f4-1aad-4438-919b-34cfb144e459 for MGC192.168.201.125@tcp 00000020:00080000:2.0:1788666285.499564:0:13242:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8ab2989a4d40) has no exports 10000000:01000000:0.0:1788666285.499716:0:5804:0:(mgc_request.c:706:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1788666285.499800:0:13242:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.125@tcp: client import never connected 00000100:00080000:2.0:1788666285.499804:0:13242:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788666285.499807:0:13242:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788666285.499809:0:13242:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788666285.499811:0:13242:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788666285.499865:0:13242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788666285.499871:0:13242:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.125@tcp (uuid 633727f4-1aad-4438-919b-34cfb144e459) 00000020:01000000:2.0:1788666285.499877:0:13242:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788666285.499880:0:13242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788666285.499883:0:13242:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788666285.499889:0:13242:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8ab2bfbf1000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788666285.499894:0:13242:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8ab2b4824d40) has exports, disconnecting them 00000020:00080000:2.0:1788666285.499898:0:13242:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8ab2bfbf1000), last request at 1788666057 00000020:00000080:2.0:1788666285.499902:0:13242:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e98d6 00000020:00080000:2.0:1788666285.499913:0:13242:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8ab2bfbf1000): rc 0 00000020:00000080:2.0:1788666285.499917:0:13242:0:(genops.c:885:class_export_put()) final put ffff8ab2bfbf1000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788666285.500244:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab298996000 for MGC192.168.201.125@tcp 00000020:00000080:1.0:1788666285.500250:0:467:0:(genops.c:885:class_export_put()) final put ffff8ab298994800/633727f4-1aad-4438-919b-34cfb144e459 00000020:00000080:1.0:1788666285.500253:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab298994800/633727f4-1aad-4438-919b-34cfb144e459 for MGC192.168.201.125@tcp 00000020:01000000:1.0:1788666285.500258:0:467:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.125@tcp (633727f4-1aad-4438-919b-34cfb144e459) 00000020:00000080:1.0:1788666285.500504:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2bfbf1000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788666285.504710:0:13242:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788666285.504718:0:13242:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788666285.504723:0:13242:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788666285.504729:0:13242:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788666285.504787:0:5796:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788666285.504901:0:5797:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788666285.504978:0:7593:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000020:00000080:1.0:1788666285.505036:0:467:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8ab2bbe64800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788666285.505106:0:7594:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1788666285.505232:0:5792:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8ab2a08e1c00:5792] 1 exiting: rc = 0 00000100:00100000:1.0:1788666285.505367:0:5791:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8ab2a08e1800:5791] 0 exiting: rc = 1 00000100:00100000:0.0:1788666285.505497:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666285.505866:0:5793:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8ab290dce800:5793] 0 exiting: rc = 1 00000100:00100000:1.0:1788666285.505922:0:12940:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8ab28622e000:12940] 3 exiting: rc = 0 00000100:00100000:0.0:1788666285.508743:0:5794:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8ab290dcf400:5794] 1 exiting: rc = 0 00000100:00100000:2.0:1788666285.522004:0:5795:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8ab29815be00:5795] 2 exiting: rc = 0 00000100:00100000:0.0:1788666285.522149:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522159:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522174:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522180:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522186:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522191:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522198:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522304:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522311:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522317:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522337:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522343:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522413:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522420:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522426:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522432:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522439:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522444:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522450:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522456:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522461:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522466:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522471:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522477:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522482:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522486:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522491:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522497:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522502:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522507:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522512:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522517:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522523:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522528:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522533:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522539:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522545:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522551:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522555:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522560:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522566:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522571:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522576:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522667:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522675:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522687:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522692:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522698:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522703:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522708:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522713:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522718:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522723:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522729:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522734:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522739:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522745:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522750:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522755:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522760:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522767:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522772:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522777:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.522782:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788666285.523805:0:13242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788666285.523824:0:13242:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788666285.523830:0:13242:0:(genops.c:885:class_export_put()) final put ffff8ab2bfbf5800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788666285.523835:0:13242:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2bfbf5800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788666285.523848:0:13242:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1788666285.523883:0:13242:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab2bbf65000 1 00000020:00000080:2.0:1788666285.523889:0:13242:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x96bbe788361e987b 00000020:00000080:2.0:1788666285.523894:0:13242:0:(genops.c:885:class_export_put()) final put ffff8ab2ae327000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788666285.523908:0:13242:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788666285.523912:0:13242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788666285.523917:0:13242:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788666285.523920:0:13242:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8ab2c19b3380) has no exports 00000020:00000080:1.0:1788666285.523979:0:467:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2ae327000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788666285.537940:0:13242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788666285.537956:0:13242:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788666285.537962:0:13242:0:(genops.c:885:class_export_put()) final put ffff8ab2865e7800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788666285.537967:0:13242:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2865e7800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788666285.537974:0:13242:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788666285.538147:0:13242:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8ab2bbf62000 00000020:01000000:2.0:1788666285.538179:0:13242:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788666285.538183:0:13242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788666285.538188:0:13242:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788666285.538191:0:13242:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8ab2857bb380) has no exports 00000020:00000080:2.0:1788666285.538215:0:13242:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788666285.538221:0:13242:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788666285.538223:0:13242:0:(genops.c:885:class_export_put()) final put ffff8ab2ae6d5000/OSS_uuid 00000020:00000080:2.0:1788666285.538226:0:13242:0:(genops.c:844:class_export_destroy()) destroying export ffff8ab2ae6d5000/OSS_uuid for OSS 00000020:01000000:2.0:1788666285.538229:0:13242:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788666285.538793:0:6651:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8ab2ae291c00:6651] 2 exiting: rc = 0 00000100:00080000:1.0:1788666285.538938:0:5803:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788666285.540962:0:6649:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8ab2857e2e00:6649] 0 exiting: rc = 1 00000100:00100000:0.0:1788666285.542574:0:8429:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8ab2c1b78800:8429] 3 exiting: rc = 0 00000100:00100000:1.0:1788666285.542706:0:6650:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8ab2857e3200:6650] 1 exiting: rc = 0 00000100:00100000:2.0:1788666285.543065:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543075:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543086:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543093:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543098:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543104:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543109:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543114:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543133:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543138:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543143:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543148:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543154:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543159:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543173:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543179:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543184:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543190:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543196:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543210:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543215:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543221:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543226:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543231:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543235:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543241:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543246:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543251:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543256:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543264:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543270:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543276:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543282:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543287:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543293:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543299:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543304:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543308:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543314:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543319:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543324:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543329:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543335:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543457:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543465:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543471:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543476:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543481:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543486:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543491:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543497:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543502:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543514:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543520:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543526:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543531:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543536:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543541:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543546:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543551:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543556:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543561:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543566:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.543571:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.545057:0:6653:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8ab2ae291600:6653] 1 exiting: rc = 0 00000100:00100000:3.0:1788666285.545255:0:6652:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8ab2ae291800:6652] 0 exiting: rc = 1 00000100:00100000:2.0:1788666285.545504:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545514:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545520:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545525:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545531:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545536:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545543:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545548:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545554:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545559:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545564:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545569:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545575:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545730:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545747:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545753:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545759:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545764:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545769:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545775:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545780:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545785:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545791:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545796:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545802:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545807:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545813:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545829:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545836:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545840:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545846:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545851:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545856:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545862:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545866:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545871:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545876:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545882:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545888:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545893:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545900:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545906:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545911:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545916:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545921:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545926:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545930:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545936:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545941:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545953:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545958:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545965:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545981:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545987:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.545995:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.546001:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.546006:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.546011:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.546016:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.546020:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.546026:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.546031:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.546036:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.546042:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788666285.547709:0:6654:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8ab2904fe400:6654] 0 exiting: rc = 1 00000100:00100000:0.0:1788666285.548035:0:6656:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8ab2ae209000:6656] 2 exiting: rc = 0 00000100:00100000:2.0:1788666285.548549:0:6655:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8ab2bbe3aa00:6655] 1 exiting: rc = 0 00000100:00100000:2.0:1788666285.549085:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549093:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549099:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549105:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549111:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549117:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549123:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549128:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549133:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549139:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549144:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549150:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549156:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549162:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549180:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549186:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549192:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549198:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549203:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549219:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549225:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549231:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549237:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549244:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549249:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549255:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549260:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549266:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549272:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549292:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549298:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549304:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549310:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549316:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549322:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549328:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549333:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549339:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549455:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549464:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549470:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549475:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549480:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549486:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549491:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549497:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549503:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549508:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549514:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549521:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549526:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549532:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549539:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549558:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549568:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549574:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549704:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549712:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549718:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549723:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549728:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549734:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549740:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.549746:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.559879:0:6657:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8ab2ae208c00:6657] 0 exiting: rc = 1 00000100:00100000:0.0:1788666285.560084:0:6658:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8ab2ae209e00:6658] 1 exiting: rc = 0 00000100:00100000:0.0:1788666285.560139:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560146:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560151:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560156:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560162:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560288:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560294:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560300:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560305:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560310:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560314:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560330:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560335:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560340:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560408:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560416:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560422:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560427:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560432:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560438:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560443:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560448:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560453:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560458:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560464:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560469:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560475:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560481:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560486:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560492:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560496:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560502:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560507:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560512:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560516:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560522:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560527:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560533:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560538:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560544:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560550:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560554:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560559:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560564:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560569:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560575:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560707:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560713:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560718:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560722:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560727:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560732:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560737:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560742:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560747:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560753:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560759:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560765:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560770:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560775:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560781:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560786:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560791:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.560797:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788666285.562098:0:6659:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8ab2bbe3ba00:6659] 0 exiting: rc = 1 00000100:00100000:1.0:1788666285.562458:0:6660:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8ab2bbe3b400:6660] 1 exiting: rc = 0 00000100:00100000:0.0:1788666285.562826:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562835:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562842:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562848:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562855:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562861:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562866:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562872:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562879:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562885:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562891:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562898:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562920:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562928:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562934:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562940:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562947:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562961:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562967:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562974:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562980:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562987:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562992:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.562998:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563017:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563023:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563029:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563035:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563042:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563048:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563053:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563060:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563066:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563072:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563078:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563083:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563100:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563108:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563114:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563120:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563126:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563131:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563138:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563145:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563151:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563157:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563163:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563282:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563302:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563308:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563488:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563494:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563506:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563511:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563518:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563524:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563531:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563537:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563543:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563549:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563568:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563574:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563702:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788666285.563709:0:13242:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788666285.574076:0:13242:0:(tgt_mount.c:2186:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788666306.372046:0:13862:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788666317.077080:0:14323:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:1.0:1788666317.077086:0:14323:0:(obd_mount.c:924:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788666317.077208:0:14323:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ab2c1c25000 00000020:01000004:1.0:1788666317.077224:0:14323:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788666317.077232:0:14323:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788666317.077256:0:14323:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8ab2b4823380) 00000020:00000080:1.0:1788666317.077270:0:14323:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788666317.095210:0:14323:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788666317.099329:0:14323:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1788666317.105716:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 661: rc = 0 00100000:10000000:1.0:1788666317.105908:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 661: rc = 0 00100000:10000000:1.0:1788666317.106013:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 661: rc = 0 00100000:10000000:1.0:1788666317.106107:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 661: rc = 0 00100000:10000000:1.0:1788666317.106268:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 661: rc = 0 00100000:10000000:1.0:1788666317.107256:0:14323:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788666317.107354:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 661: rc = 0 00100000:10000000:1.0:1788666317.108941:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 663: rc = 0 00100000:10000000:1.0:1788666317.112398:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 726: rc = 0 00100000:10000000:1.0:1788666317.112570:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 726: rc = 0 00100000:10000000:1.0:1788666317.113458:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 539: rc = 0 00100000:10000000:2.0:1788666317.116223:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 539: rc = 0 00100000:10000000:2.0:1788666317.118327:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 539: rc = 0 00100000:10000000:2.0:1788666317.119066:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 539: rc = 0 00100000:10000000:2.0:1788666317.119348:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 539: rc = 0 00100000:10000000:2.0:1788666317.120965:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 539: rc = 0 00100000:10000000:2.0:1788666317.121229:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 539: rc = 0 00100000:10000000:2.0:1788666317.123024:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 539: rc = 0 00100000:10000000:2.0:1788666317.123640:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 539: rc = 0 00100000:10000000:2.0:1788666317.123909:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 539: rc = 0 00100000:10000000:2.0:1788666317.124165:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 539: rc = 0 00100000:10000000:2.0:1788666317.124482:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 539: rc = 0 00100000:10000000:2.0:1788666317.124970:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 450: rc = 0 00100000:10000000:2.0:1788666317.125218:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 450: rc = 0 00100000:10000000:2.0:1788666317.125487:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 450: rc = 0 00100000:10000000:2.0:1788666317.125758:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 450: rc = 0 00100000:10000000:2.0:1788666317.126009:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 450: rc = 0 00100000:10000000:2.0:1788666317.126255:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 450: rc = 0 00100000:10000000:2.0:1788666317.126552:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 450: rc = 0 00100000:10000000:2.0:1788666317.126841:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 450: rc = 0 00100000:10000000:2.0:1788666317.127088:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 450: rc = 0 00100000:10000000:3.0:1788666317.133120:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 450: rc = 0 00100000:10000000:3.0:1788666317.133491:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 450: rc = 0 00100000:10000000:3.0:1788666317.134164:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 450: rc = 0 00100000:10000000:3.0:1788666317.134423:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 450: rc = 0 00100000:10000000:3.0:1788666317.134855:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 450: rc = 0 00100000:10000000:3.0:1788666317.135122:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 450: rc = 0 00100000:10000000:3.0:1788666317.135380:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 450: rc = 0 00100000:10000000:3.0:1788666317.137108:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 450: rc = 0 00100000:10000000:3.0:1788666317.137712:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 450: rc = 0 00100000:10000000:3.0:1788666317.137965:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 450: rc = 0 00100000:10000000:3.0:1788666317.138212:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 450: rc = 0 00100000:10000000:3.0:1788666317.143870:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 450: rc = 0 00100000:10000000:3.0:1788666317.144206:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 450: rc = 0 00100000:10000000:3.0:1788666317.144505:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 450: rc = 0 00100000:10000000:3.0:1788666317.145506:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 450: rc = 0 00100000:10000000:3.0:1788666317.145862:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 450: rc = 0 00100000:10000000:3.0:1788666317.146137:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 450: rc = 0 00100000:10000000:3.0:1788666317.147248:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 450: rc = 0 00100000:10000000:3.0:1788666317.147847:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 450: rc = 0 00100000:10000000:3.0:1788666317.148116:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 450: rc = 0 00100000:10000000:3.0:1788666317.152219:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 450: rc = 0 00100000:10000000:3.0:1788666317.154288:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 450: rc = 0 00100000:10000000:3.0:1788666317.154631:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 450: rc = 0 00100000:10000000:3.0:1788666317.155013:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 194: rc = 0 00100000:10000000:3.0:1788666317.158242:0:14323:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788666317.158459:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 727: rc = 0 00100000:10000000:3.0:1788666317.163661:0:14323:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788666317.163771:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 727: rc = 0 00100000:10000000:3.0:1788666317.164010:0:14323:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788666317.164080:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 727: rc = 0 00100000:10000000:3.0:1788666317.164474:0:14323:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788666317.164550:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 437: rc = 0 00100000:10000000:3.0:1788666317.164804:0:14323:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788666317.164878:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 437: rc = 0 00100000:10000000:3.0:1788666317.165075:0:14323:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788666317.165146:0:14323:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 437: rc = 0 00000020:00000080:3.0:1788666317.165449:0:14323:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788666317.165457:0:14323:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788666317.165469:0:14323:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96bbe788361ea9a0 00000020:01000004:3.0:1788666317.165478:0:14323:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788666317.165484:0:14323:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788666317.165489:0:14323:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab2c1c25000 from MGS 00000020:01000004:3.0:1788666317.165494:0:14323:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788666317.165504:0:14323:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8ab2b44e4d40) 00000020:00000080:3.0:1788666317.165518:0:14323:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788666317.165575:0:14323:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab2c1c25000 from MGS, refs=2 00080000:01000000:3.0:1788666317.165620:0:14323:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788666317.165626:0:14323:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96bbe788361ea9ae 00000100:00100000:3.0:1788666317.165735:0:14323:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788666317.165881:0:14323:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788666317.165888:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788666317.173281:0:14323:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788666317.173294:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788666317.174071:0:14323:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788666317.174348:0:14323:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788666317.174355:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788666317.174984:0:14323:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788666317.174991:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788666317.175503:0:14323:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788666317.175509:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788666317.176190:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666317.176195:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666317.176196:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666317.176841:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666317.176844:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666317.176846:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666317.177901:0:14323:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788666317.179721:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788666317.188174:0:14323:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788666317.188196:0:14323:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788666317.188199:0:14323:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788666317.189783:0:14332:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788666317.189945:0:14323:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788666317.190047:0:14323:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788666317.190539:0:14323:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788666317.190961:0:14323:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788666317.191140:0:14323:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788666317.191146:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788666317.191817:0:14323:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788666317.191829:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788666317.192128:0:14323:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788666317.192134:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788666317.192892:0:14323:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788666317.192913:0:14323:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.125@tcp' 00000020:01000004:1.0:1788666317.192916:0:14323:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788666317.192948:0:14323:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.125@tcp (typ=mgc) 00000020:00000080:1.0:1788666317.192960:0:14323:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.125@tcp (ffff8ab2b4820000) 00000020:00000080:1.0:1788666317.192975:0:14323:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788666317.193046:0:14323:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab2c1c26000@MGC192.168.201.125@tcp: add connection 192.168.201.125@tcp at head 00010000:00010000:1.0:1788666317.193188:0:14323:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.125@tcp-0 is initialized 00000040:01000000:1.0:1788666317.193194:0:14323:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788666317.193337:0:14336:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788666317.202855:0:14339:0:(mgc_request.c:629:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788666317.202948:0:14323:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.125@tcp (uuid d6055fb2-45b5-486f-b848-f99f52ec1d9c) 00000020:00000080:1.0:1788666317.202970:0:14323:0:(genops.c:1385:class_connect()) connect: client d6055fb2-45b5-486f-b848-f99f52ec1d9c, cookie 0x96bbe788361ea9bc 00000100:00080000:1.0:1788666317.202983:0:14323:0:(import.c:545:import_select_connection()) MGC192.168.201.125@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788666317.202990:0:14323:0:(import.c:665:import_select_connection()) MGC192.168.201.125@tcp: import ffff8ab2c1c26000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:1.0:1788666317.203025:0:14323:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab2ae978700 x1875552186228736/t0(0) o250->MGC192.168.201.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788666317.203053:0:14323:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d6055fb2-45b5-486f-b848-f99f52ec1d9c->MGS 00000020:01000004:1.0:1788666317.203078:0:14323:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788666317.203084:0:14323:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788666317.203097:0:14323:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8ab2b4824d40) 00000020:00000080:1.0:1788666317.203110:0:14323:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788666317.204038:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae978700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3274:1875552186228736:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788666317.204132:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666317.204399:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186228736 00000100:00100000:3.0:1788666317.204408:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186228736 00000100:00100000:3.0:1788666317.204447:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788666317.204457:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b60c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3274:x1875552186228736:12345-0@lo:250:mount.lustre.0 00010000:00080000:3.0:1788666317.204488:0:14333:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d6055fb2-45b5-486f-b848-f99f52ec1d9c@0@lo t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:3.0:1788666317.204518:0:14333:0:(genops.c:1385:class_connect()) connect: client d6055fb2-45b5-486f-b848-f99f52ec1d9c, cookie 0x96bbe788361ea9ca 00000100:00080000:3.0:1788666317.210622:0:14333:0:(import.c:65:import_set_state_nolock()) ffff8ab2b4217800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788666317.210742:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b60c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+5:3274:x1875552186228736:12345-0@lo:250:mount.lustre.0 Request processed in 6282us (6606us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666317.210754:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788666317.210994:0:3274:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.125@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788666317.211004:0:3274:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.201.125@tcp: connect to target with instance 0 00000100:00080000:2.0:1788666317.211012:0:3274:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.201.125@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788666317.211017:0:3274:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788666317.211021:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab2c1c26000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788666317.211024:0:3274:0:(mgc_request.c:1166:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788666317.211043:0:3274:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788666317.211049:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae978700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3274:1875552186228736:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788666317.245778:0:14323:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788666317.246290:0:14323:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788666317.246297:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788666317.248950:0:14323:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788666317.248967:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788666317.249567:0:14323:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788666317.249574:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788666317.250879:0:14323:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788666317.251152:0:14323:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788666317.251158:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788666317.256195:0:14323:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788666317.256334:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788666317.312194:0:14323:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788666317.312455:0:14323:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788666317.312463:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788666317.322477:0:14323:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788666317.322501:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788666317.324983:0:14323:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788666317.325179:0:14323:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788666317.325186:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788666317.329904:0:14323:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788666317.329917:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788666317.331057:0:14323:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788666317.331237:0:14323:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788666317.331242:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788666317.333151:0:14323:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788666317.333164:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788666317.334197:0:14323:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788666317.334446:0:14323:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788666317.334452:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788666317.335627:0:14323:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788666317.335638:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788666317.362708:0:14323:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788666317.362964:0:14323:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788666317.362971:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788666317.370574:0:14323:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788666317.370622:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788666317.371779:0:14323:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788666317.371792:0:14323:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788666317.373416:0:14323:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788666317.373447:0:14323:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788666317.373454:0:14323:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.125@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788666317.373652:0:14323:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788666317.373690:0:14323:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.125@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788666317.373695:0:14323:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788666317.373697:0:14323:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788666317.373702:0:14323:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788666317.373703:0:14323:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788666317.373704:0:14323:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788666317.373706:0:14323:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788666317.373707:0:14323:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788666317.373708:0:14323:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788666317.373710:0:14323:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788666317.373711:0:14323:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788666317.373714:0:14323:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788666317.373716:0:14323:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788666317.373717:0:14323:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788666317.373718:0:14323:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788666317.373719:0:14323:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788666317.373720:0:14323:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788666317.373721:0:14323:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788666317.373722:0:14323:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788666317.373723:0:14323:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788666317.373724:0:14323:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788666317.373724:0:14323:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788666317.373757:0:14323:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788666317.373776:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186228864:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788666317.373857:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666317.373917:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab282cd5a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788666317.374061:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186228864 00000100:00100000:2.0:1788666317.374076:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186228864 00000100:00100000:2.0:1788666317.374134:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788666317.374143:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b60c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+5:14323:x1875552186228864:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788666317.374191:0:14335:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788666317.374194:0:14335:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788666317.374197:0:14335:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788666317.374561:0:14357:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788666317.374937:0:14335:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1788666317.381011:0:14358:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788666317.381021:0:14358:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788666317.381025:0:14358:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788666317.381058:0:14358:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788666317.381818:0:14335:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788666317.381830:0:14335:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788666317.422901:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b60c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+5:14323:x1875552186228864:12345-0@lo:253:mount.lustre.0 Request processed in 48745us (49030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666317.422922:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788666317.423121:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186228864:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788666317.423136:0:14323:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788666317.423139:0:14323:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788666317.423141:0:14323:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788666317.423142:0:14323:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788666317.423143:0:14323:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788666317.423144:0:14323:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788666317.423146:0:14323:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788666317.423147:0:14323:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788666317.423148:0:14323:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788666317.423150:0:14323:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788666317.423151:0:14323:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788666317.423170:0:14323:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab2c1c25000 from lustre-MDT0000 10000000:01000000:0.0:1788666317.423199:0:14323:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788666317.423216:0:14323:0:(mgc_request.c:327:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788666317.423221:0:14323:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8ab2b4820000 10000000:01000000:0.0:1788666317.423227:0:14323:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788666317.423235:0:14323:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-sptlrpc-ffff8ab2b4820000 from 1 10000000:01000000:0.0:1788666317.423238:0:14323:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788666317.423319:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2bfa7f000/0x96bbe788361ea9d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666317.423330:0:14323:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2bfa7f000/0x96bbe788361ea9d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666317.423340:0:14323:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2bfa7f000/0x96bbe788361ea9d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666317.423362:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186228992:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788666317.423412:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666317.423450:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab282cd50c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788666317.426540:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186228992 00000100:00100000:3.0:1788666317.426556:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186228992 00000100:00100000:0.0:1788666317.429114:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788666317.429134:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b60c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+5:14323:x1875552186228992:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788666317.429152:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666317.429173:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2bfa7f400/0x96bbe788361ea9d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361ea9d1 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666317.429202:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2bfa7f400/0x96bbe788361ea9d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361ea9d1 expref: 6 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666317.429214:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2bfa7f400/0x96bbe788361ea9d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361ea9d1 expref: 6 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666317.429224:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2bfa7f400, rc 0) 00000100:00100000:0.0:1788666317.429342:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b60c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+6:14323:x1875552186228992:12345-0@lo:101:mount.lustre.0 Request processed in 216us (5930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666317.429350:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788666317.429450:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186228992:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788666317.429469:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2bfa7f000/0x96bbe788361ea9d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361ea9d8 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666317.429486:0:14323:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2bfa7f000/0x96bbe788361ea9d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361ea9d8 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666317.429562:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186229120:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788666317.429628:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666317.430105:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2b9d31000 going to sleep for 11 seconds 00000100:00100000:3.0:1788666317.430217:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186229120 00000100:00100000:3.0:1788666317.430224:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186229120 00000100:00100000:3.0:1788666317.430252:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788666317.430259:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b60c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+6:14323:x1875552186229120:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666317.430512:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b60c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+6:14323:x1875552186229120:12345-0@lo:501:mount.lustre.0 Request processed in 253us (883us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788666317.430521:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788666317.432399:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186229120:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788666317.432449:0:14323:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788666317.432527:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2bfa7f000/0x96bbe788361ea9d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361ea9d8 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666317.432540:0:14323:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2bfa7f000/0x96bbe788361ea9d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361ea9d8 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666317.432549:0:14323:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab2c1c25000 10000000:01000000:1.0:1788666317.432558:0:14323:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788666317.432563:0:14323:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8ab2c1c25000 10000000:01000000:1.0:1788666317.432566:0:14323:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788666317.432570:0:14323:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-barrier-ffff8ab2c1c25000 from 1 10000000:01000000:1.0:1788666317.432572:0:14323:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788666317.432786:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab298855e00/0x96bbe788361ea9df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666317.432794:0:14323:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab298855e00/0x96bbe788361ea9df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666317.432805:0:14323:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab298855e00/0x96bbe788361ea9df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666317.432838:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186229248:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788666317.432897:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666317.432935:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2b9d31000 going to sleep for 11 seconds 00000100:00100000:0.0:1788666317.433018:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186229248 00000100:00100000:0.0:1788666317.433025:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186229248 00000100:00100000:0.0:1788666317.433079:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788666317.433089:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b60c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+6:14323:x1875552186229248:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788666317.433102:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666317.433116:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2bfa7f800/0x96bbe788361ea9e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361ea9df expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666317.433139:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2bfa7f800/0x96bbe788361ea9e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361ea9df expref: 7 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666317.433150:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2bfa7f800/0x96bbe788361ea9e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361ea9df expref: 7 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666317.433157:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2bfa7f800, rc 0) 00000100:00100000:0.0:1788666317.433193:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b60c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+7:14323:x1875552186229248:12345-0@lo:101:mount.lustre.0 Request processed in 107us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666317.433200:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788666317.433302:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186229248:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788666317.433315:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab298855e00/0x96bbe788361ea9df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361ea9e6 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666317.433323:0:14323:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab298855e00/0x96bbe788361ea9df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361ea9e6 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666317.433335:0:14323:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788666317.433561:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab298855e00/0x96bbe788361ea9df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361ea9e6 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666317.433571:0:14323:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab298855e00/0x96bbe788361ea9df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361ea9e6 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666317.433577:0:14323:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788666317.434219:0:14323:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788666317.434227:0:14323:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8ab2c1c25000 10000000:01000000:1.0:1788666317.434232:0:14323:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788666317.434236:0:14323:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788666317.434238:0:14323:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788666317.434262:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab298854c00/0x96bbe788361ea9ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666317.434283:0:14323:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab298854c00/0x96bbe788361ea9ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666317.434302:0:14323:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab298854c00/0x96bbe788361ea9ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666317.434319:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186229376:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788666317.434358:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666317.434396:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2b9d31000 going to sleep for 11 seconds 00000100:00100000:0.0:1788666317.434457:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186229376 00000100:00100000:0.0:1788666317.434464:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186229376 00000100:00100000:0.0:1788666317.434500:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788666317.434508:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a088a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+7:14323:x1875552186229376:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788666317.434519:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666317.434529:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2bfa7e600/0x96bbe788361ea9f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361ea9ed expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666317.434557:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2bfa7e600/0x96bbe788361ea9f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361ea9ed expref: 8 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666317.434566:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2bfa7e600/0x96bbe788361ea9f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361ea9ed expref: 8 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666317.434574:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2bfa7e600, rc 0) 00000100:00100000:0.0:1788666317.434906:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a088a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+8:14323:x1875552186229376:12345-0@lo:101:mount.lustre.0 Request processed in 398us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666317.434912:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788666317.434996:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186229376:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788666317.435010:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab298854c00/0x96bbe788361ea9ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361ea9f4 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666317.435018:0:14323:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab298854c00/0x96bbe788361ea9ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361ea9f4 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666317.435064:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1abaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186229504:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788666317.435089:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666317.435116:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab298371600 going to sleep for 11 seconds 00000100:00100000:0.0:1788666317.435161:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186229504 00000100:00100000:0.0:1788666317.435165:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186229504 00000100:00100000:0.0:1788666317.435193:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788666317.435200:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a088ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+8:14323:x1875552186229504:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788666317.435818:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1abaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186229504:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788666317.435849:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1abaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186229632:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788666317.435889:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666317.435913:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186229632 00000100:00100000:2.0:1788666317.435917:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186229632 00000100:00100000:2.0:1788666317.435936:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788666317.435943:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a088b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+10:14323:x1875552186229632:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788666317.436235:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a088b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+10:14323:x1875552186229632:12345-0@lo:503:mount.lustre.0 Request processed in 292us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666317.436243:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788666317.436297:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab298371600 going to sleep for 11 seconds 00000100:00100000:2.0:1788666317.436310:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1abaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186229632:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788666317.436445:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a088ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+9:14323:x1875552186229504:12345-0@lo:501:mount.lustre.0 Request processed in 410us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666317.436453:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788666317.436890:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14359:1875552186229760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788666317.436932:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666317.436994:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab283b71900 going to sleep for 11 seconds 00000100:00100000:2.0:1788666317.437164:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186229760 00000100:00100000:2.0:1788666317.437171:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186229760 00000100:00100000:2.0:1788666317.437241:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788666317.437249:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a0888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+9:14359:x1875552186229760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788666317.437562:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a0888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+9:14359:x1875552186229760:12345-0@lo:502:llog_process_th.0 Request processed in 314us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666317.437570:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788666317.438091:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14359:1875552186229760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788666317.438120:0:14359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788666317.438133:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666317.438136:0:14359:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788666317.438144:0:14359:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788666317.438147:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788666317.438167:0:14359:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8ab2b48219c0) 00000020:00000080:1.0:1788666317.438191:0:14359:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788666317.438198:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788666317.438296:0:14359:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788666317.438304:0:14359:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96bbe788361eaa02 00000020:00000080:1.0:1788666317.438531:0:14359:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788666317.438536:0:14359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788666317.438540:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666317.438541:0:14359:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788666317.438544:0:14359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788666317.438548:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666317.438549:0:14359:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788666317.438552:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788666317.438560:0:14359:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8ab2a0cab380) 00000020:00000080:1.0:1788666317.440749:0:14359:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788666317.440773:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788666317.440776:0:14359:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788666317.440793:0:14359:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788666317.440803:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788666317.440877:0:14359:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab2c1c25000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788666317.440898:0:14359:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8ab2a0ca8000) 00000020:00000080:1.0:1788666317.440911:0:14359:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788666317.440970:0:14359:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788666317.440978:0:14359:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96bbe788361eaa17 00000020:00000080:1.0:1788666317.441102:0:14359:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788666317.441108:0:14359:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788666317.441112:0:14359:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x96bbe788361eaa1e 00080000:01000000:1.0:1788666317.441118:0:14359:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788666317.441122:0:14359:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96bbe788361eaa25 00010000:00010000:1.0:1788666317.503065:0:14359:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788666317.504332:0:14359:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1788666317.504559:0:14359:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788666317.505492:0:14359:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8ab2a0cacd40) 00000020:00000080:1.0:1788666317.505515:0:14359:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788666317.505641:0:14359:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788666317.505648:0:14359:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96bbe788361eaa33 00000020:00000080:0.0:1788666317.506415:0:14359:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788666317.519947:0:14359:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x96bbe788361eaa3a 00000020:00000080:3.0:1788666317.520654:0:14359:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788666317.520669:0:14359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666317.520675:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666317.520678:0:14359:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788666317.520681:0:14359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666317.520687:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666317.520689:0:14359:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788666317.520693:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788666317.520732:0:14359:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788666317.520745:0:14359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666317.520749:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666317.520750:0:14359:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788666317.520753:0:14359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788666317.520755:0:14359:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:3.0:1788666317.520757:0:14359:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788666317.520758:0:14359:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788666317.520770:0:14359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788666317.520773:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666317.520774:0:14359:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788666317.520777:0:14359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788666317.520781:0:14359:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788666317.520785:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666317.520786:0:14359:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788666317.520789:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788666317.520794:0:14359:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.125@tcp to nid 0x20000c0a8c97d (192.168.201.125@tcp) 00000020:01000000:3.0:1788666317.520823:0:14359:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788666317.520826:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788666317.520843:0:14359:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8ab2b44e0000) 00000020:00000080:3.0:1788666317.520980:0:14359:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788666317.520988:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788666317.521054:0:14359:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788666317.521060:0:14359:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788666317.521067:0:14359:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96bbe788361eaa48 00010000:00080000:3.0:1788666317.521103:0:14359:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab2a02ee800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.125@tcp at head 00010000:00010000:3.0:1788666317.521330:0:14359:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788666317.522104:0:14359:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788666317.522150:0:14359:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788666317.524352:0:14359:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788666317.524391:0:14359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788666317.524475:0:14359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788666317.525061:0:14363:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788666317.525066:0:14363:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788666317.525831:0:14359:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788666317.525845:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788666317.525878:0:14359:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788666317.525901:0:14359:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96bbe788361eaa4f 00000100:00080000:3.0:1788666317.525912:0:14359:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788666317.525919:0:14359:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ab2a02ee800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:3.0:1788666317.525955:0:14359:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab2b456c700 x1875552186229888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788666317.525991:0:14359:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1788666317.526034:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186229888:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788666317.526045:0:14359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666317.526048:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666317.526050:0:14359:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788666317.526053:0:14359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788666317.526055:0:14359:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788666317.526056:0:14359:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788666317.526058:0:14359:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788666317.526060:0:14359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788666317.526062:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666317.526063:0:14359:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788666317.526066:0:14359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788666317.526069:0:14359:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788666317.526072:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666317.526073:0:14359:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788666317.526076:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788666317.526079:0:14359:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.125@tcp to nid 0x20000c0a8c97d (192.168.201.125@tcp) 00000400:00000100:2.0:1788666317.526086:0:3274:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875552186229888 offset 0 length 520: 4 00000020:01000000:3.0:1788666317.526099:0:14359:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788666317.526101:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788666317.526112:0:14359:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8ab2b44e19c0) 00000020:00000080:3.0:1788666317.526124:0:14359:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788666317.526128:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788666317.526192:0:14359:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788666317.526199:0:14359:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788666317.526204:0:14359:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x96bbe788361eaa5d 00010000:00080000:3.0:1788666317.526239:0:14359:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab2bf987000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.125@tcp at head 00010000:00010000:3.0:1788666317.527175:0:14359:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788666317.527949:0:14359:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788666317.527985:0:14359:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788666317.530239:0:14359:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788666317.530347:0:14359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788666317.530466:0:14359:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788666317.532897:0:14365:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788666317.532905:0:14365:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788666317.539561:0:14359:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788666317.540014:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788666317.540056:0:14359:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788666317.540079:0:14359:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96bbe788361eaa64 00000100:00080000:3.0:1788666317.540090:0:14359:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788666317.540096:0:14359:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ab2bf987000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:3.0:1788666317.540135:0:14359:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab2b456fb80 x1875552186230016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788666317.540163:0:14359:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788666317.540220:0:14359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666317.540224:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666317.540226:0:14359:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788666317.540229:0:14359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666317.540233:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666317.540235:0:14359:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788666317.540237:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788666317.540239:0:14359:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788666317.540242:0:14359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666317.540244:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666317.540245:0:14359:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788666317.540248:0:14359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666317.540250:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666317.540251:0:14359:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788666317.540255:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788666317.540309:0:14359:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14359:1875552186230144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788666317.540404:0:14359:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666317.540444:0:14359:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab1811653c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666317.541637:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186230016:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788666317.541688:0:3274:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875552186230016 offset 0 length 520: 4 00000100:00100000:2.0:1788666317.542750:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186230144 00000100:00100000:2.0:1788666317.542763:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186230144 00000100:00100000:2.0:1788666317.542822:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788666317.542831:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a088b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+9:14359:x1875552186230144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788666317.543155:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a088b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+9:14359:x1875552186230144:12345-0@lo:502:llog_process_th.0 Request processed in 324us (2750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666317.543164:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788666317.543343:0:14359:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14359:1875552186230144:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788666317.543379:0:14359:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666317.543391:0:14359:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666317.543393:0:14359:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788666317.543399:0:14359:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788666317.543800:0:14323:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788666317.543819:0:14323:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788666317.543832:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab298854c00/0x96bbe788361ea9ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361ea9f4 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666317.543844:0:14323:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab298854c00/0x96bbe788361ea9ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361ea9f4 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666317.544819:0:14323:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff8ab2c1c25000 from 1 10000000:01000000:2.0:1788666317.544823:0:14323:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788666317.545015:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f2e00/0x96bbe788361eaa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666317.545026:0:14323:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f2e00/0x96bbe788361eaa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666317.545037:0:14323:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f2e00/0x96bbe788361eaa6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666317.545061:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1abaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186230272:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788666317.545123:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666317.545213:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab290586900 going to sleep for 11 seconds 00000100:00100000:1.0:1788666317.547923:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186230272 00000100:00100000:1.0:1788666317.547945:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186230272 00000100:00100000:1.0:1788666317.548050:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788666317.548063:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a0888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+9:14323:x1875552186230272:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788666317.548082:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666317.548106:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab298855400/0x96bbe788361eaa72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361eaa6b expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666317.548139:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab298855400/0x96bbe788361eaa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361eaa6b expref: 10 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666317.548152:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab298855400/0x96bbe788361eaa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eaa6b expref: 10 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666317.548169:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855400, rc 0) 00000100:00100000:1.0:1788666317.548282:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a0888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+10:14323:x1875552186230272:12345-0@lo:101:mount.lustre.0 Request processed in 222us (3158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666317.548289:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788666317.553982:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1abaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186230272:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788666317.554018:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f2e00/0x96bbe788361eaa6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eaa72 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.554031:0:14323:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f2e00/0x96bbe788361eaa6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361eaa72 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666317.554575:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186230400:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788666317.554687:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666317.554732:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab1811653c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666317.554868:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186230400 00000100:00100000:2.0:1788666317.554878:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186230400 00000100:00100000:2.0:1788666317.554939:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788666317.554951:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a0889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+10:14323:x1875552186230400:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788666317.554974:0:14335:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788666317.554980:0:14335:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788666317.555054:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a0889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+10:14323:x1875552186230400:12345-0@lo:256:mount.lustre.0 Request processed in 105us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666317.555073:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788666317.555918:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186230400:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788666317.556515:0:14323:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788666317.556728:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f2e00/0x96bbe788361eaa6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eaa72 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.556741:0:14323:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f2e00/0x96bbe788361eaa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eaa72 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666317.556750:0:14323:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff8ab2c1c25000 from 1 10000000:01000000:3.0:1788666317.556753:0:14323:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788666317.556800:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8e00/0x96bbe788361eaa79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.556809:0:14323:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8e00/0x96bbe788361eaa79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.556881:0:14323:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8e00/0x96bbe788361eaa79 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666317.556906:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186230528:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788666317.556972:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666317.557007:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab1811653c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666317.557070:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186230528 00000100:00100000:1.0:1788666317.557078:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186230528 00000100:00100000:1.0:1788666317.557129:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788666317.557138:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a0888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+10:14323:x1875552186230528:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788666317.557151:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666317.557166:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab298855000/0x96bbe788361eaa80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361eaa79 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666317.557188:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab298855000/0x96bbe788361eaa80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361eaa79 expref: 11 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666317.557197:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab298855000/0x96bbe788361eaa80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eaa79 expref: 11 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666317.557207:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855000, rc 0) 00000100:00100000:1.0:1788666317.557245:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a0888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+11:14323:x1875552186230528:12345-0@lo:101:mount.lustre.0 Request processed in 108us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666317.557251:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788666317.558798:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186230528:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788666317.558826:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8e00/0x96bbe788361eaa79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eaa80 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.558839:0:14323:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8e00/0x96bbe788361eaa79 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361eaa80 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666317.558935:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186230656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666317.559001:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666317.559043:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab1811653c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666317.559124:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186230656 00000100:00100000:1.0:1788666317.559131:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186230656 00000100:00100000:1.0:1788666317.559177:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788666317.559186:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+11:14323:x1875552186230656:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788666317.560367:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+11:14323:x1875552186230656:12345-0@lo:501:mount.lustre.0 Request processed in 1176us (1359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666317.560388:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788666317.565983:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186230656:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666317.567043:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186230784:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788666317.567133:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666317.567181:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab181165a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788666317.567322:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186230784 00000100:00100000:0.0:1788666317.567329:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186230784 00000100:00100000:0.0:1788666317.567391:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788666317.567404:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+11:14323:x1875552186230784:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788666317.568062:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+11:14323:x1875552186230784:12345-0@lo:503:mount.lustre.0 Request processed in 658us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666317.568072:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788666317.568168:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186230784:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788666317.569120:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14367:1875552186230912:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788666317.569194:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666317.569278:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab288a8a9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788666317.569322:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186230912 00000100:00100000:3.0:1788666317.569329:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186230912 00000100:00100000:3.0:1788666317.569407:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788666317.569416:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+11:14367:x1875552186230912:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788666317.569896:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+11:14367:x1875552186230912:12345-0@lo:502:llog_process_th.0 Request processed in 479us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666317.569909:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788666317.570007:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14367:1875552186230912:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788666317.570038:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788666317.570047:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666317.570050:0:14367:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788666317.570056:0:14367:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab2c1c25000 00000020:00000080:2.0:1788666317.570059:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788666317.570066:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788666317.570069:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666317.570070:0:14367:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788666317.570072:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788666317.570075:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666317.570076:0:14367:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788666317.570079:0:14367:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab2c1c25000 00000020:00000080:2.0:1788666317.570081:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788666317.570149:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788666317.570152:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666317.570154:0:14367:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788666317.570156:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788666317.570159:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666317.570161:0:14367:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788666317.570164:0:14367:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab2c1c25000 00000020:00000080:2.0:1788666317.570166:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788666317.570206:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1aba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14367:1875552186231040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788666317.570245:0:14367:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666317.574316:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab290586840 going to sleep for 11 seconds 00000100:00100000:1.0:1788666317.574409:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186231040 00000100:00100000:1.0:1788666317.574419:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186231040 00000100:00100000:1.0:1788666317.574472:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788666317.574482:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+11:14367:x1875552186231040:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788666317.574975:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+11:14367:x1875552186231040:12345-0@lo:502:llog_process_th.0 Request processed in 492us (4727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666317.574984:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788666317.575753:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1aba300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14367:1875552186231040:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788666317.575790:0:14367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788666317.575799:0:14367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788666317.575801:0:14367:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788666317.575806:0:14367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788666317.583379:0:14323:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788666317.583417:0:14323:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788666317.583440:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8e00/0x96bbe788361eaa79 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eaa80 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.583453:0:14323:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8e00/0x96bbe788361eaa79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eaa80 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666317.583523:0:14323:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788666317.583527:0:14323:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff8ab2c1c25000 10000000:01000000:3.0:1788666317.583529:0:14323:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab2c1c25000 10000000:01000000:3.0:1788666317.583534:0:14323:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788666317.583540:0:14323:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff8ab2c1c25000 from 1 10000000:01000000:3.0:1788666317.583543:0:14323:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788666317.583626:0:14323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8400/0x96bbe788361eaa87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.583636:0:14323:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8400/0x96bbe788361eaa87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.583647:0:14323:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8400/0x96bbe788361eaa87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666317.583674:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186231168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788666317.583863:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666317.583906:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab282cd5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788666317.584289:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186231168 00000100:00100000:1.0:1788666317.584298:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186231168 00000100:00100000:1.0:1788666317.584353:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788666317.584363:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+11:14323:x1875552186231168:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788666317.584380:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666317.584396:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab298854a00/0x96bbe788361eaa8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361eaa87 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666317.584424:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab298854a00/0x96bbe788361eaa8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361eaa87 expref: 12 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666317.584437:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab298854a00/0x96bbe788361eaa8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eaa87 expref: 12 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666317.586385:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298854a00, rc 0) 00000100:00100000:1.0:1788666317.586483:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:14323:x1875552186231168:12345-0@lo:101:mount.lustre.0 Request processed in 2119us (2616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666317.586500:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788666317.597141:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186231168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788666317.597173:0:14323:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8400/0x96bbe788361eaa87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eaa8e expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.597196:0:14323:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8400/0x96bbe788361eaa87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361eaa8e expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666317.597318:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186231296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666317.597398:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666317.597446:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab282cd5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788666317.597739:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186231296 00000100:00100000:1.0:1788666317.597748:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186231296 00000100:00100000:1.0:1788666317.597802:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788666317.597813:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:14323:x1875552186231296:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788666317.598127:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:14323:x1875552186231296:12345-0@lo:501:mount.lustre.0 Request processed in 316us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666317.598135:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788666317.598643:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186231296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666317.598682:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186231424:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788666317.598740:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666317.598769:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab282cd5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788666317.599944:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186231424 00000100:00100000:1.0:1788666317.600009:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186231424 00000100:00100000:1.0:1788666317.600066:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788666317.600075:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:14323:x1875552186231424:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788666317.600294:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:14323:x1875552186231424:12345-0@lo:503:mount.lustre.0 Request processed in 220us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666317.600301:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788666317.600410:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186231424:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788666317.614929:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14372:1875552186231552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788666317.615025:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666317.615123:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a08ac6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788666317.615209:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186231552 00000100:00100000:3.0:1788666317.615216:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186231552 00000100:00100000:3.0:1788666317.615308:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788666317.615319:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:14372:x1875552186231552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788666317.615622:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:14372:x1875552186231552:12345-0@lo:502:llog_process_th.0 Request processed in 305us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666317.615630:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788666317.615982:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14372:1875552186231552:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788666317.616044:0:14372:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788666317.616059:0:14372:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8ab2c19b4d40) 00000020:00000080:0.0:1788666317.616078:0:14372:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788666317.616165:0:14372:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab2c1c25000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788666317.616169:0:14372:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab2c1c25000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788666317.616171:0:14372:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab2c1c25000 4 00010000:00080000:0.0:1788666317.616200:0:14372:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab2b5f83800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.125@tcp at head 00010000:00010000:0.0:1788666317.617805:0:14372:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:0.0:1788666317.618017:0:14372:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788666317.618057:0:14372:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788666317.618070:0:14372:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x96bbe788361eaa9c 00000100:00080000:0.0:1788666317.618081:0:14372:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788666317.618088:0:14372:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ab2b5f83800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1788666317.618122:0:14372:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab2b480c380 x1875552186231680/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788666317.618146:0:14372:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788666317.619066:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875552186231680:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788666317.619156:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666317.621113:0:14372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14372:1875552186231808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788666317.621193:0:14372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666317.621555:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186231680 00000100:00100000:0.0:1788666317.621562:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186231680 00000100:00100000:0.0:1788666317.621626:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788666317.621633:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3274:x1875552186231680:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788666317.621756:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3274:x1875552186231680:12345-0@lo:38:llog_process_th.0 Request processed in 62us (2540us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788666317.621764:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788666317.621808:0:3274:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788666317.621816:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab2b5f83800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788666317.621820:0:3274:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788666317.621824:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875552186231680:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788666317.622279:0:14372:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2905863c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666317.622395:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186231808 00000100:00100000:1.0:1788666317.622401:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186231808 00000100:00100000:1.0:1788666317.622434:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788666317.622441:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:14372:x1875552186231808:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788666317.622748:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:14372:x1875552186231808:12345-0@lo:502:llog_process_th.0 Request processed in 306us (1554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666317.622754:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788666317.625862:0:14372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14372:1875552186231808:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788666317.625911:0:14372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788666317.628231:0:14323:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788666317.628276:0:14323:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788666317.628302:0:14323:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8400/0x96bbe788361eaa87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eaa8e expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666317.628316:0:14323:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8400/0x96bbe788361eaa87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eaa8e expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788666317.628369:0:14323:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788666317.628371:0:14323:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788666317.628372:0:14323:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788666317.628373:0:14323:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788666317.628375:0:14323:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788666317.628376:0:14323:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788666317.628377:0:14323:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788666317.628379:0:14323:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788666317.628381:0:14323:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788666317.628382:0:14323:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788666317.628386:0:14323:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788666317.628388:0:14323:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788666317.628389:0:14323:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788666317.628390:0:14323:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788666317.628391:0:14323:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788666317.628397:0:14323:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788666317.628398:0:14323:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788666317.628399:0:14323:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788666317.628400:0:14323:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788666317.628401:0:14323:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788666317.628402:0:14323:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788666317.628442:0:14323:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788666317.628465:0:14323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186231936:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788666317.628537:0:14323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666317.628598:0:14323:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a08acc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788666317.628702:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186231936 00000100:00100000:1.0:1788666317.628710:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186231936 00000100:00100000:1.0:1788666317.628755:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788666317.628764:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:14323:x1875552186231936:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788666317.628797:0:14335:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788666317.628811:0:14335:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788666317.670521:0:14335:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788666317.670543:0:14335:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788666317.672191:0:14357:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788666317.672201:0:14357:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788666317.672226:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab2b47f2000/0x96bbe788361eaaa3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666317.672245:0:14357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab298855400/0x96bbe788361eaa72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eaa6b expref: 12 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666317.672253:0:14357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab2b47f2000/0x96bbe788361eaaa3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666317.672306:0:14357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab298855400/0x96bbe788361eaa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361eaa6b expref: 12 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666317.672321:0:14357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab298855400/0x96bbe788361eaa72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361eaa6b expref: 12 pid: 14334 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666317.672360:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14357:1875552186232064:0@lo:104: 00000100:00100000:2.0:1788666317.672435:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666317.672485:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab290586840 going to sleep for 11 seconds 00000100:00100000:1.0:1788666317.672563:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186232064 00000100:00100000:1.0:1788666317.672570:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186232064 00000100:00100000:1.0:1788666317.672658:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788666317.672667:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+3:14357:x1875552186232064:12345-0@lo:104: 00010000:00010000:1.0:1788666317.672681:0:14324:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f2e00/0x96bbe788361eaa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361eaa72 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666317.672732:0:14324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788666317.672738:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+3:14357:x1875552186232064:12345-0@lo:104: Request processed in 73us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666317.672746:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788666317.672936:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab9c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14357:1875552186232064:0@lo:104: 00010000:00010000:2.0:1788666317.672958:0:14357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab2b47f2000/0x96bbe788361eaaa3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.673057:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666317.673065:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f2e00/0x96bbe788361eaa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361eaa72 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.673072:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2e00 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:3.0:1788666317.673076:0:14330:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f2e00/0x96bbe788361eaa6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361eaa72 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.673102:0:14330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f2e00/0x96bbe788361eaa6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361eaa72 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788666317.673109:0:14330:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f2e00/0x96bbe788361eaa6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361eaa72 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666317.673114:0:14330:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788666317.673151:0:14330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f2e00/0x96bbe788361eaa6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361eaa72 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.673157:0:14330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788666317.673175:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f2e00/0x96bbe788361eaa6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361eaa72 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.673182:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f2e00/0x96bbe788361eaa6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361eaa72 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.673198:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666317.673199:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666317.673201:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666317.673219:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788666317.673228:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3276:1875552186232192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788666317.673260:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666317.673322:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186232192 00000100:00100000:3.0:1788666317.673327:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186232192 00010000:00010000:3.0:1788666317.673345:0:14326:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab298855400/0x96bbe788361eaa72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361eaa6b expref: 13 pid: 14334 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666317.673364:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788666317.673376:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+13:3276:x1875552186232192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788666317.673386:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666317.673392:0:14326:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab298855400/0x96bbe788361eaa72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361eaa6b expref: 13 pid: 14334 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.673403:0:14326:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab298855400/0x96bbe788361eaa72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361eaa6b expref: 13 pid: 14334 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.673416:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab298855400/0x96bbe788361eaa72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361eaa6b expref: 13 pid: 14334 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.673429:0:14326:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab2b47f2000/0x96bbe788361eaaa3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.673437:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2b47f2000/0x96bbe788361eaaa3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788666317.673450:0:14326:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001250151s 00010000:00010000:3.0:1788666317.673455:0:14326:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab2b47f2000/0x96bbe788361eaaa3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.673463:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab2b47f2000/0x96bbe788361eaaa3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.673469:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab2b47f2000/0x96bbe788361eaaa3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.673475:0:14326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab2b47f2000/0x96bbe788361eaaa3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.673480:0:14326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2000 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666317.673489:0:14326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab2b47f2000/0x96bbe788361eaaa3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.673496:0:14326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab2b47f2000/0x96bbe788361eaaa3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.673507:0:14326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab2b47f2000/0x96bbe788361eaaa3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666317.673515:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666317.673544:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:3276:x1875552186232192:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666317.673550:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788666317.673599:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3276:1875552186232192:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788666317.673825:0:14357:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab2b47f2000/0x96bbe788361eaaa3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666317.673834:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab2b47f2000/0x96bbe788361eaaa3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666317.673840:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2b47f2000/0x96bbe788361eaaa3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666317.691064:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+11:14323:x1875552186231936:12345-0@lo:253:mount.lustre.0 Request processed in 62286us (62512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666317.691081:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788666317.692214:0:14323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14323:1875552186231936:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788666317.692233:0:14323:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788666317.692236:0:14323:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788666317.692238:0:14323:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788666317.692240:0:14323:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788666317.692241:0:14323:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788666317.692243:0:14323:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788666317.692245:0:14323:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788666317.692246:0:14323:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788666317.692247:0:14323:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788666317.692250:0:14323:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788666317.692251:0:14323:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788666317.692281:0:14323:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788666317.704982:0:14323:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788666317.705178:0:14323:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788666317.705932:0:14323:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788666317.706105:0:14323:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788666317.706391:0:14323:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788666317.706544:0:14323:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788666317.708018:0:14323:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788666317.708186:0:14323:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788666317.708465:0:14323:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788666317.708988:0:14323:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788666317.709399:0:14323:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788666317.709551:0:14323:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1788666317.743332:0:14323:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788666317.743943:0:14323:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788666317.744075:0:14379:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788666317.744087:0:14379:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788666317.744362:0:14380:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1788666317.744453:0:14380:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788666317.746531:0:14380:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788666317.746650:0:14380:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788666317.746655:0:14380:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1788666317.750360:0:14323:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788666317.750534:0:14323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788666317.751793:0:14323:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788666317.751811:0:14323:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788666317.752014:0:14323:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788666317.753234:0:14323:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788666317.754047:0:14323:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788666317.754092:0:14323:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788666317.756158:0:14323:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1788666317.767135:0:14323:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788666317.813312:0:14323:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788666317.813353:0:14323:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffacf70195f988 00100000:10000000:1.0:1788666317.813362:0:14323:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788666317.815771:0:14323:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788666317.815793:0:14323:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.125@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788666317.815885:0:14323:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1788666317.815917:0:14323:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788666318.219855:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788666318.606100:0:14373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788666318.922758:0:14339:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788666318.922774:0:14339:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff8ab2c1c25000 from 6 10000000:01000000:2.0:1788666318.922780:0:14339:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788666318.922912:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f3400/0x96bbe788361eaaaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666318.922925:0:14339:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f3400/0x96bbe788361eaaaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666318.922937:0:14339:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f3400/0x96bbe788361eaaaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666318.922963:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186232320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788666318.923053:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666318.923727:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab290586780 going to sleep for 11 seconds 00000100:00100000:3.0:1788666318.926116:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186232320 00000100:00100000:3.0:1788666318.926135:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186232320 00000100:00100000:3.0:1788666318.926197:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788666318.926209:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+11:14339:x1875552186232320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666318.926230:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666318.926260:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2b47e8800/0x96bbe788361eaab1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361eaaaa expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666318.926290:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2b47e8800/0x96bbe788361eaab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361eaaaa expref: 12 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666318.926302:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2b47e8800/0x96bbe788361eaab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eaaaa expref: 12 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666318.926311:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e8800, rc 0) 00000100:00100000:3.0:1788666318.926404:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:14339:x1875552186232320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (3350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666318.926412:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788666318.926475:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186232320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666318.926491:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f3400/0x96bbe788361eaaaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eaab1 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666318.926501:0:14339:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f3400/0x96bbe788361eaaaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361eaab1 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666318.926572:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186232448:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788666318.926649:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666318.926681:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab285757300 going to sleep for 11 seconds 00000100:00100000:3.0:1788666318.926695:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186232448 00000100:00100000:3.0:1788666318.926699:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186232448 00000100:00100000:3.0:1788666318.926721:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788666318.926728:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:14339:x1875552186232448:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788666318.926745:0:14335:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788666318.926763:0:14335:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788666318.926766:0:14335:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788666318.927054:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:14339:x1875552186232448:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 325us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666318.927062:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788666318.927097:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186232448:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788666318.927132:0:14339:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788666318.927141:0:14339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f3400/0x96bbe788361eaaaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eaab1 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666318.927149:0:14339:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f3400/0x96bbe788361eaaaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eaab1 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666319.255059:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788666319.627447:0:14373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788666320.266728:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666321.295289:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666322.314689:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788666322.828134:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788666322.828142:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788666322.828145:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788666322.828147:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788666322.828150:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788666322.828153:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788666322.828157:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab2b5f83800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788666322.828171:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8ab2b5f83800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:0.0:1788666322.828204:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab2b480f100 x1875552186232704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788666322.828525:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875552186232704:0@lo:38:kworker.0 00000100:00100000:3.0:1788666322.828623:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666322.828696:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3276:1875552186232576:0@lo:400:kworker.0 00000100:00100000:3.0:1788666322.828728:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666322.828770:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186232576 00000100:00100000:3.0:1788666322.828793:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186232576 00000100:00100000:3.0:1788666322.828841:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788666322.828850:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:3276:x1875552186232576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666322.829046:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:3276:x1875552186232576:12345-0@lo:400:kworker.0 Request processed in 196us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666322.829054:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788666322.829104:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3276:1875552186232576:0@lo:400:kworker.0 00000100:00100000:1.0:1788666322.829635:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186232704 00000100:00100000:1.0:1788666322.829641:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186232704 00000100:00100000:1.0:1788666322.829710:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788666322.829717:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3274:x1875552186232704:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788666322.829743:0:14343:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 429 last 0 00000020:00000080:1.0:1788666322.829778:0:14343:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x96bbe788361eaab8 00000004:00100000:1.0:1788666322.829792:0:14343:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788666322.831345:0:14343:0:(import.c:65:import_set_state_nolock()) ffff8ab291040000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788666322.832536:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3274:x1875552186232704:12345-0@lo:38:kworker.0 Request processed in 2811us (3905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666322.832561:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788666322.833052:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ab2b480f100 x1875552186232704/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788666332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788666322.833074:0:3274:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788666322.833083:0:3274:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788666322.833089:0:3274:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788666322.833093:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab2b5f83800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788666322.833100:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3274:1875552186232704:0@lo:38:kworker.0 00000001:02000400:0.0:1788666323.271961:0:14623:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788666323.342903:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666324.363244:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666325.393546:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666326.411570:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788666326.478475:0:14774:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd118a5fa0 20000000:00000080:2.0:1788666326.478497:0:14774:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab2bc80a400 uarg=0000000000000000 20000000:01000000:2.0:1788666326.478535:0:14774:0:(mgs_llog.c:6191:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788666326.478542:0:14774:0:(mgs_llog.c:4646:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788666326.478547:0:14774:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788666326.481883:0:14775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788666326.484840:0:14774:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788666326.497729:0:14774:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788666326.499681:0:14774:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab298855600/0x96bbe788361eaabf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666326.499705:0:14774:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab298855000/0x96bbe788361eaa80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eaa79 expref: 11 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666326.499714:0:14774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab298855600/0x96bbe788361eaabf lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666326.499761:0:14774:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab298855000/0x96bbe788361eaa80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361eaa79 expref: 11 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666326.499774:0:14774:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab298855000/0x96bbe788361eaa80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361eaa79 expref: 11 pid: 14333 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666326.499790:0:14774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae978a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14774:1875552186232832:0@lo:104: 00000100:00100000:1.0:1788666326.499873:0:14774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666326.499927:0:14774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28f360600 going to sleep for 11 seconds 00000100:00100000:2.0:1788666326.500068:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186232832 00000100:00100000:2.0:1788666326.500075:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186232832 00000100:00100000:2.0:1788666326.500132:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788666326.500142:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae978380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+3:14774:x1875552186232832:12345-0@lo:104: 00010000:00010000:2.0:1788666326.500157:0:14325:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8e00/0x96bbe788361eaa79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361eaa80 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666326.500208:0:14325:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788666326.500224:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae978380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+3:14774:x1875552186232832:12345-0@lo:104: Request processed in 84us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666326.500231:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788666326.500427:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666326.500433:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8e00/0x96bbe788361eaa79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361eaa80 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666326.500440:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e8e00 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:1.0:1788666326.500444:0:14330:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8e00/0x96bbe788361eaa79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361eaa80 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666326.500472:0:14330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8e00/0x96bbe788361eaa79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361eaa80 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788666326.500479:0:14330:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8e00/0x96bbe788361eaa79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361eaa80 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666326.500485:0:14330:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788666326.500517:0:14330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8e00/0x96bbe788361eaa79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361eaa80 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666326.500523:0:14330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788666326.500548:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8e00/0x96bbe788361eaa79 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361eaa80 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666326.500556:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8e00/0x96bbe788361eaa79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361eaa80 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666326.500575:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666326.500576:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666326.500634:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666326.500660:0:14774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae978a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14774:1875552186232832:0@lo:104: 00010000:00010000:1.0:1788666326.500678:0:14774:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab298855600/0x96bbe788361eaabf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666326.500763:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3277:1875552186232960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788666326.500807:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666326.501021:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186232960 00000100:00100000:1.0:1788666326.501027:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186232960 00010000:00010000:1.0:1788666326.501048:0:14326:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab298855000/0x96bbe788361eaa80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361eaa79 expref: 12 pid: 14333 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666326.501081:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788666326.501096:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1aba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:3277:x1875552186232960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788666326.501107:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666326.501124:0:14326:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab298855000/0x96bbe788361eaa80 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361eaa79 expref: 12 pid: 14333 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666326.501134:0:14326:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab298855000/0x96bbe788361eaa80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361eaa79 expref: 12 pid: 14333 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666326.501148:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab298855000/0x96bbe788361eaa80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361eaa79 expref: 12 pid: 14333 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666326.501160:0:14326:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab298855600/0x96bbe788361eaabf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666326.501167:0:14326:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab298855600/0x96bbe788361eaabf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666326.501179:0:14326:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab298855600/0x96bbe788361eaabf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666326.501186:0:14326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab298855600/0x96bbe788361eaabf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666326.501193:0:14326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab298855600/0x96bbe788361eaabf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666326.501200:0:14326:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab298855600/0x96bbe788361eaabf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666326.501206:0:14326:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855600 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:1.0:1788666326.501210:0:14326:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab298855600/0x96bbe788361eaabf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666326.501223:0:14326:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab298855600/0x96bbe788361eaabf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666326.501244:0:14326:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab298855600/0x96bbe788361eaabf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666326.501268:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666326.501323:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1aba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+11:3277:x1875552186232960:12345-0@lo:103:ldlm_bl.0 Request processed in 228us (514us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666326.501330:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788666326.501356:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3277:1875552186232960:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788666326.501425:0:14774:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab298855600/0x96bbe788361eaabf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666326.501434:0:14774:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab298855600/0x96bbe788361eaabf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666326.501440:0:14774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab298855600/0x96bbe788361eaabf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14774 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666327.434813:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788666327.564398:0:14339:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:3.0:1788666327.564406:0:14339:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff8ab2c1c25000 from 10 10000000:01000000:3.0:1788666327.564411:0:14339:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788666327.564483:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8600/0x96bbe788361eaac6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666327.564496:0:14339:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8600/0x96bbe788361eaac6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666327.564508:0:14339:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8600/0x96bbe788361eaac6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666327.564537:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186233088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788666327.565226:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666327.565279:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab285757a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788666327.567520:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186233088 00000100:00100000:3.0:1788666327.567538:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186233088 00000100:00100000:3.0:1788666327.567630:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788666327.567641:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+11:14339:x1875552186233088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666327.567660:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666327.567681:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2b47e8e00/0x96bbe788361eaacd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361eaac6 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666327.567709:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2b47e8e00/0x96bbe788361eaacd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361eaac6 expref: 12 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666327.567722:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2b47e8e00/0x96bbe788361eaacd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eaac6 expref: 12 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666327.567732:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e8e00, rc 0) 00000100:00100000:3.0:1788666327.567822:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:14339:x1875552186233088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (2596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666327.567829:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788666327.567895:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186233088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666327.567916:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8600/0x96bbe788361eaac6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eaacd expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666327.567926:0:14339:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8600/0x96bbe788361eaac6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361eaacd expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666327.568000:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186233216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788666327.568036:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666327.568080:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab285757a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788666327.568128:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186233216 00000100:00100000:3.0:1788666327.568133:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186233216 00000100:00100000:3.0:1788666327.568158:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788666327.568165:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bcd57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:14339:x1875552186233216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788666327.568448:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bcd57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:14339:x1875552186233216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666327.568456:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788666327.568489:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186233216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788666327.568517:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186233344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788666327.568555:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666327.568568:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab285757a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788666327.568606:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186233344 00000100:00100000:3.0:1788666327.568611:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186233344 00000100:00100000:3.0:1788666327.568633:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788666327.568639:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bcd54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:14339:x1875552186233344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788666327.568793:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bcd54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:14339:x1875552186233344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666327.568800:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788666327.568836:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186233344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788666327.569509:0:14807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788666327.569571:0:14339:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788666327.569615:0:14339:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788666327.569626:0:14339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8600/0x96bbe788361eaac6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eaacd expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666327.569656:0:14339:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8600/0x96bbe788361eaac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eaacd expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666327.948361:0:3274:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788666317/real 1788666317] req@ffff8ab2b456fb80 x1875552186230016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666327 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666327.948400:0:3274:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab2b456fb80 x1875552186230016/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666327 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666327.948409:0:3274:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788666317/real 1788666317] req@ffff8ab2b456c700 x1875552186229888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666327 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666327.948420:0:3274:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab2b456c700 x1875552186229888/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666327 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788666327.948436:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab2bf987000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788666327.948457:0:3274:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788666327.948460:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186230016:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788666327.948466:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab2a02ee800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788666327.948471:0:3274:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788666327.948473:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186229888:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788666327.948530:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788666327.948570:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788666327.948573:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab2a02ee800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788666327.948601:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 424 00000100:00080000:2.0:1788666327.948607:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788666327.948614:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ab2a02ee800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:2.0:1788666327.948644:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab2c1ab9880 x1875552186233472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788666327.948659:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788666327.948662:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788666327.948664:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab2bf987000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788666327.948666:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 424 00000100:00080000:2.0:1788666327.948669:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788666327.948672:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ab2bf987000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:2.0:1788666327.948682:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab2c1ab8380 x1875552186233600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788666327.948721:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875552186233728:0@lo:400:kworker.0 00000100:00100000:2.0:1788666327.948812:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666327.948894:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186233728 00000100:00100000:2.0:1788666327.948902:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186233728 00000100:00100000:2.0:1788666327.948938:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788666327.948946:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875552186233728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666327.948995:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875552186233728:12345-0@lo:400:kworker.0 Request processed in 49us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666327.949002:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788666327.949034:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ab2c1ab8a80 x1875552186233728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666343 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666327.949045:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875552186233728:0@lo:400:kworker.0 00000100:00100000:3.0:1788666327.949150:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186233472:0@lo:8:kworker.0 00000400:00000100:3.0:1788666327.949178:0:3274:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875552186233472 offset 0 length 520: 4 00000100:00100000:3.0:1788666327.949198:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186233600:0@lo:8:kworker.0 00000400:00000100:3.0:1788666327.949215:0:3274:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875552186233600 offset 0 length 520: 4 00010000:00010000:1.0:1788666328.463125:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666329.489546:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788666329.868612:0:14373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788666330.507388:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666331.533103:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788666331.721514:0:15022:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:0.0:1788666331.721517:0:15022:0:(obd_mount.c:924:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788666331.721634:0:15022:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ab2b44dd800 00000020:01000004:0.0:1788666331.721648:0:15022:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788666331.721658:0:15022:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788666331.721681:0:15022:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8ab2c19b0000) 00000020:00000080:0.0:1788666331.721695:0:15022:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788666331.741757:0:15022:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788666331.742242:0:15022:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788666331.743483:0:15022:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788666331.744822:0:15022:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788666331.745064:0:15022:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788666331.745652:0:15022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 479: rc = 0 00100000:10000000:3.0:1788666331.745753:0:15022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 479: rc = 0 00100000:10000000:3.0:1788666331.745838:0:15022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 479: rc = 0 00100000:10000000:3.0:1788666331.747064:0:15022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 622: rc = 0 00100000:10000000:3.0:1788666331.747881:0:15022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 622: rc = 0 00100000:10000000:3.0:1788666331.748524:0:15022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 622: rc = 0 00100000:10000000:3.0:1788666331.750694:0:15022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 622: rc = 0 00100000:10000000:3.0:1788666331.751073:0:15022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 622: rc = 0 00100000:10000000:2.0:1788666331.751800:0:15022:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 622: rc = 0 00000020:00000080:2.0:1788666331.752862:0:15022:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788666331.752875:0:15022:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788666331.752887:0:15022:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x96bbe788361eaadb 00000020:01000004:2.0:1788666331.752975:0:15022:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788666331.752998:0:15022:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.125@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788666331.753001:0:15022:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.201.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788666331.753007:0:15022:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788666331.753013:0:15022:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788666331.753036:0:15022:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8ab2857bb380) 00000020:00000080:2.0:1788666331.753047:0:15022:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788666331.756290:0:15022:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788666331.757166:0:15022:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788666331.757173:0:15022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788666331.758208:0:15022:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788666331.758218:0:15022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788666331.767260:0:15022:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788666331.767276:0:15022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788666331.772490:0:15022:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788666331.772743:0:15022:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788666331.772758:0:15022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788666331.773821:0:15022:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788666331.773829:0:15022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788666331.820816:0:15022:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788666331.821309:0:15022:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788666331.821316:0:15022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788666331.824766:0:15022:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788666331.824783:0:15022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788666331.825788:0:15022:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788666331.825798:0:15022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788666331.829872:0:15022:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788666331.830255:0:15022:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788666331.830262:0:15022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788666331.831473:0:15022:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788666331.831484:0:15022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1788666331.990650:0:15022:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788666331.990865:0:15022:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1788666331.990870:0:15022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788666331.994081:0:15022:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788666331.994095:0:15022:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788666331.995445:0:15022:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788666331.995479:0:15022:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788666331.995485:0:15022:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.125@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788666332.025048:0:15022:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788666332.025093:0:15022:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.125@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788666332.025099:0:15022:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788666332.025100:0:15022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788666332.025102:0:15022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788666332.025102:0:15022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788666332.025103:0:15022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788666332.025104:0:15022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788666332.025106:0:15022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788666332.025107:0:15022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788666332.025108:0:15022:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788666332.025112:0:15022:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788666332.025114:0:15022:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788666332.025115:0:15022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788666332.025116:0:15022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788666332.025117:0:15022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788666332.025118:0:15022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788666332.025119:0:15022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788666332.025120:0:15022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788666332.025121:0:15022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788666332.025121:0:15022:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788666332.025227:0:15022:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788666332.025253:0:15022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186233856:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788666332.025333:0:15022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666332.025437:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186233856 00000100:00100000:3.0:1788666332.025450:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186233856 00000100:00100000:3.0:1788666332.025522:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788666332.025531:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bcd57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:15022:x1875552186233856:12345-0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788666332.025547:0:15022:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab288a8a6c0 going to sleep for 11 seconds 20000000:01000000:3.0:1788666332.025564:0:14335:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788666332.025568:0:14335:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788666332.025571:0:14335:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788666332.035285:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bcd57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:15022:x1875552186233856:12345-0@lo:253:mount.lustre.0 Request processed in 9744us (9942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666332.035301:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788666332.035456:0:15022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186233856:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788666332.035472:0:15022:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788666332.035475:0:15022:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788666332.035478:0:15022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788666332.035493:0:15022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788666332.035495:0:15022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788666332.035496:0:15022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788666332.035497:0:15022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788666332.035499:0:15022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788666332.035500:0:15022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788666332.035502:0:15022:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788666332.035522:0:15022:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab2b44dd800 from lustre-OST0000 10000000:01000000:0.0:1788666332.035549:0:15022:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788666332.035552:0:15022:0:(mgc_request.c:327:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788666332.035558:0:15022:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ab2b4820000 local copy 00010000:00010000:0.0:1788666332.035569:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2bfa7f000/0x96bbe788361ea9d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361ea9d8 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666332.035894:0:15022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186233984:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788666332.036058:0:15022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666332.037115:0:15022:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab288a8af00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666332.037175:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186233984 00000100:00100000:2.0:1788666332.037185:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186233984 00000100:00100000:2.0:1788666332.037284:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788666332.037294:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bcd56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:15022:x1875552186233984:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788666332.037571:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bcd56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:15022:x1875552186233984:12345-0@lo:501:mount.lustre.0 Request processed in 278us (1513us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788666332.037610:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788666332.037825:0:15022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186233984:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788666332.038006:0:15022:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788666332.038187:0:15022:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788666332.038197:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2bfa7f000/0x96bbe788361ea9d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361ea9d8 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666332.038209:0:15022:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2bfa7f000/0x96bbe788361ea9d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361ea9d8 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666332.038237:0:15022:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab2b44dd800 10000000:01000000:3.0:1788666332.038242:0:15022:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788666332.038247:0:15022:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8ab2b4820000 10000000:01000000:3.0:1788666332.038249:0:15022:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788666332.038253:0:15022:0:(mgc_request.c:1800:mgc_process_log()) Process log nodemap-ffff8ab2b4820000 from 1 10000000:01000000:3.0:1788666332.038255:0:15022:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788666332.038290:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8200/0x96bbe788361eaae9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666332.038298:0:15022:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8200/0x96bbe788361eaae9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666332.038307:0:15022:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8200/0x96bbe788361eaae9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666332.038427:0:15022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186234112:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788666332.038467:0:15022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666332.038541:0:15022:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516180 going to sleep for 11 seconds 00000100:00100000:2.0:1788666332.038647:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186234112 00000100:00100000:2.0:1788666332.038654:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186234112 00000100:00100000:2.0:1788666332.038732:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788666332.038741:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bcd55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+12:15022:x1875552186234112:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788666332.038752:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666332.038767:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2b47f2a00/0x96bbe788361eaaf0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361eaae9 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666332.038790:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2b47f2a00/0x96bbe788361eaaf0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361eaae9 expref: 13 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666332.038800:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2b47f2a00/0x96bbe788361eaaf0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eaae9 expref: 13 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666332.038809:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2a00, rc 0) 00000100:00100000:2.0:1788666332.038851:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bcd55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+13:15022:x1875552186234112:12345-0@lo:101:mount.lustre.0 Request processed in 110us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666332.038864:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788666332.038967:0:15022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186234112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788666332.038980:0:15022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8200/0x96bbe788361eaae9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eaaf0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666332.038988:0:15022:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8200/0x96bbe788361eaae9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361eaaf0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666332.039004:0:15022:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788666332.039029:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8200/0x96bbe788361eaae9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eaaf0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666332.039037:0:15022:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8200/0x96bbe788361eaae9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eaaf0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666332.039044:0:15022:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788666332.039048:0:15022:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788666332.039052:0:15022:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788666332.039055:0:15022:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788666332.039069:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8a00/0x96bbe788361eaaf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666332.039076:0:15022:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8a00/0x96bbe788361eaaf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666332.039083:0:15022:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8a00/0x96bbe788361eaaf7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666332.039102:0:15022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186234240:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788666332.039128:0:15022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666332.039294:0:15022:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516180 going to sleep for 11 seconds 00000100:00100000:2.0:1788666332.039389:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186234240 00000100:00100000:2.0:1788666332.039394:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186234240 00000100:00100000:2.0:1788666332.039412:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788666332.039419:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bcd54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+13:15022:x1875552186234240:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788666332.039427:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666332.039435:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2b47f3a00/0x96bbe788361eaafe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361eaaf7 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666332.039449:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2b47f3a00/0x96bbe788361eaafe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361eaaf7 expref: 14 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666332.039458:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2b47f3a00/0x96bbe788361eaafe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eaaf7 expref: 14 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666332.039464:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f3a00, rc 0) 00000100:00100000:2.0:1788666332.039502:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bcd54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+14:15022:x1875552186234240:12345-0@lo:101:mount.lustre.0 Request processed in 83us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666332.039508:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788666332.039638:0:15022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186234240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788666332.039647:0:15022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8a00/0x96bbe788361eaaf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eaafe expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666332.039655:0:15022:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8a00/0x96bbe788361eaaf7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361eaafe expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788666332.040315:0:15022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788666332.041264:0:15022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788666332.041530:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788666332.041574:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788666332.041655:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788666332.041700:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788666332.041735:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788666332.041769:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788666332.041830:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788666332.041839:0:15022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788666332.041922:0:15022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186234368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666332.041988:0:15022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666332.042035:0:15022:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516000 going to sleep for 11 seconds 00000100:00100000:2.0:1788666332.042309:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186234368 00000100:00100000:2.0:1788666332.042317:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186234368 00000100:00100000:2.0:1788666332.042354:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788666332.042375:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bcd55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+14:15022:x1875552186234368:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788666332.042765:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bcd55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+14:15022:x1875552186234368:12345-0@lo:501:mount.lustre.0 Request processed in 402us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666332.042772:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788666332.043042:0:15022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186234368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666332.043082:0:15022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186234496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788666332.043119:0:15022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666332.043192:0:15022:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516000 going to sleep for 11 seconds 00000100:00100000:1.0:1788666332.043317:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186234496 00000100:00100000:1.0:1788666332.043322:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186234496 00000100:00100000:2.0:1788666332.044479:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788666332.044617:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+14:15022:x1875552186234496:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788666332.045003:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+14:15022:x1875552186234496:12345-0@lo:503:mount.lustre.0 Request processed in 502us (1883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666332.045011:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788666332.045088:0:15022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186234496:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788666332.046763:0:15022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788666332.046862:0:15022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186234624:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788666332.046939:0:15022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666332.046981:0:15022:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516000 going to sleep for 11 seconds 00000100:00100000:1.0:1788666332.047058:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186234624 00000100:00100000:1.0:1788666332.047065:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186234624 00000100:00100000:1.0:1788666332.047097:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788666332.047104:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+14:15022:x1875552186234624:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788666332.047360:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+14:15022:x1875552186234624:12345-0@lo:502:mount.lustre.0 Request processed in 255us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666332.047442:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788666332.048784:0:15022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186234624:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788666332.049118:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788666332.049180:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788666332.049216:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788666332.049268:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788666332.049300:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788666332.049326:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788666332.050901:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788666332.051053:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788666332.051089:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788666332.051148:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788666332.051181:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788666332.051222:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788666332.051270:0:15022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186234752:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788666332.051352:0:15022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666332.051974:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186234752 00000100:00100000:1.0:1788666332.051985:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186234752 00000100:00100000:1.0:1788666332.052042:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788666332.052051:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+14:15022:x1875552186234752:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788666332.052268:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+14:15022:x1875552186234752:12345-0@lo:502:mount.lustre.0 Request processed in 218us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666332.052276:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788666332.052465:0:15022:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a1516000 going to sleep for 11 seconds 00000100:00100000:3.0:1788666332.052485:0:15022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186234752:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788666332.052568:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1788666332.052595:0:15022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1788666332.055687:0:15036:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788666332.055700:0:15036:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788666332.055706:0:15036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666332.055708:0:15036:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788666332.055713:0:15036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788666332.055728:0:15036:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8ab2b44e3380) 00000020:00000080:3.0:1788666332.055750:0:15036:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788666332.055754:0:15036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788666332.055838:0:15036:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab2b44dd800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788666332.055845:0:15036:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788666332.055851:0:15036:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x96bbe788361eab0c 00010000:00010000:3.0:1788666332.062161:0:15036:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788666332.062667:0:15036:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788666332.064705:0:15036:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788666332.066078:0:15036:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788666332.066091:0:15036:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666332.066097:0:15036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666332.066100:0:15036:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788666332.066103:0:15036:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788666332.066105:0:15036:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1788666332.066107:0:15036:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788666332.066109:0:15036:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788666332.066110:0:15036:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788666332.066112:0:15036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666332.066114:0:15036:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788666332.066116:0:15036:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666332.066119:0:15036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666332.066120:0:15036:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788666332.066123:0:15036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788666332.066125:0:15036:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788666332.066127:0:15036:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666332.066137:0:15036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666332.066139:0:15036:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788666332.066143:0:15036:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666332.066146:0:15036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666332.066147:0:15036:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788666332.066150:0:15036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788666332.066206:0:15036:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666332.066209:0:15036:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666332.066211:0:15036:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788666332.066214:0:15036:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1788666332.066518:0:15022:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1788666332.066541:0:15022:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788666332.066564:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8a00/0x96bbe788361eaaf7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eaafe expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666332.066607:0:15022:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8a00/0x96bbe788361eaaf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eaafe expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666332.066617:0:15022:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff8ab2b44dd800 from 1 10000000:01000000:1.0:1788666332.066621:0:15022:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788666332.066658:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab298855600/0x96bbe788361eab13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666332.066666:0:15022:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab298855600/0x96bbe788361eab13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666332.066676:0:15022:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab298855600/0x96bbe788361eab13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666332.066699:0:15022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186234880:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788666332.066764:0:15022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666332.066807:0:15022:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab288b96a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788666332.066914:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186234880 00000100:00100000:2.0:1788666332.066922:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186234880 00000100:00100000:2.0:1788666332.066970:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788666332.066979:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+14:15022:x1875552186234880:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788666332.066992:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666332.067004:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2b47f2600/0x96bbe788361eab1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361eab13 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666332.067038:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2b47f2600/0x96bbe788361eab1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361eab13 expref: 15 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666332.067048:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2b47f2600/0x96bbe788361eab1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eab13 expref: 15 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666332.067057:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f2600, rc 0) 00000100:00100000:2.0:1788666332.067098:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+15:15022:x1875552186234880:12345-0@lo:101:mount.lustre.0 Request processed in 120us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666332.067104:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788666332.067232:0:15022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186234880:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788666332.067246:0:15022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab298855600/0x96bbe788361eab13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eab1a expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666332.067269:0:15022:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab298855600/0x96bbe788361eab13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361eab1a expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788666332.068493:0:15022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1788666332.072562:0:15022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788666332.075766:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1788666332.075858:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1788666332.075927:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1788666332.075934:0:15022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1788666332.076052:0:15022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186235008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788666332.076121:0:15022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666332.076166:0:15022:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab288b96a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788666332.076201:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186235008 00000100:00100000:1.0:1788666332.076208:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186235008 00000100:00100000:1.0:1788666332.076247:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788666332.076256:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+15:15022:x1875552186235008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788666332.080687:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+15:15022:x1875552186235008:12345-0@lo:501:mount.lustre.0 Request processed in 4420us (4555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666332.080703:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788666332.080911:0:15022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186235008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788666332.080973:0:15022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186235136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788666332.081035:0:15022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666332.081065:0:15022:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab1823573c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666332.082995:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186235136 00000100:00100000:1.0:1788666332.083010:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186235136 00000100:00100000:1.0:1788666332.083087:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788666332.083099:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+15:15022:x1875552186235136:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788666332.083378:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+15:15022:x1875552186235136:12345-0@lo:503:mount.lustre.0 Request processed in 270us (2331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666332.083386:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788666332.083656:0:15022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186235136:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788666332.084450:0:15022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788666332.084546:0:15022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186235264:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788666332.084627:0:15022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666332.084655:0:15022:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab1823573c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666332.085375:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186235264 00000100:00100000:2.0:1788666332.085384:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186235264 00000100:00100000:2.0:1788666332.085434:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788666332.085444:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+15:15022:x1875552186235264:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788666332.085677:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+15:15022:x1875552186235264:12345-0@lo:502:mount.lustre.0 Request processed in 234us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666332.085685:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788666332.086519:0:15022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186235264:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788666332.086845:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788666332.088511:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788666332.088631:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788666332.088675:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788666332.088713:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788666332.088762:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788666332.088798:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788666332.088834:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788666332.088888:0:15022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186235392:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788666332.088975:0:15022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666332.089039:0:15022:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab1823573c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666332.089197:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186235392 00000100:00100000:1.0:1788666332.089206:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186235392 00000100:00100000:1.0:1788666332.089262:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788666332.089273:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b607b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+15:15022:x1875552186235392:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788666332.089471:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b607b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+15:15022:x1875552186235392:12345-0@lo:502:mount.lustre.0 Request processed in 200us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666332.089479:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788666332.090302:0:15022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186235392:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788666332.090506:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788666332.090520:0:15022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788666332.092519:0:15040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788666332.092534:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666332.092536:0:15040:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788666332.092553:0:15040:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab2b44dd800 00000020:00000080:0.0:1788666332.092555:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788666332.092562:0:15040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788666332.092565:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666332.092567:0:15040:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788666332.092570:0:15040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788666332.092573:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666332.092575:0:15040:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788666332.092843:0:15040:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab2b44dd800 00000020:00000080:0.0:1788666332.092847:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788666332.093048:0:15040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788666332.093052:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666332.093053:0:15040:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788666332.093057:0:15040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788666332.093066:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666332.093068:0:15040:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788666332.093072:0:15040:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab2b44dd800 00000020:00000080:0.0:1788666332.093074:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788666332.093468:0:15040:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788666332.093472:0:15040:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666332.093474:0:15040:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788666332.093479:0:15040:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788666332.093660:0:15022:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788666332.093683:0:15022:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788666332.095275:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab298855600/0x96bbe788361eab13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eab1a expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666332.095298:0:15022:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab298855600/0x96bbe788361eab13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eab1a expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666332.095358:0:15022:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788666332.095369:0:15022:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff8ab2b44dd800 10000000:01000000:2.0:1788666332.095372:0:15022:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab2b44dd800 10000000:01000000:2.0:1788666332.095377:0:15022:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788666332.095383:0:15022:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff8ab2b44dd800 from 1 10000000:01000000:2.0:1788666332.095386:0:15022:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788666332.095422:0:15022:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f3600/0x96bbe788361eab21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666332.095430:0:15022:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f3600/0x96bbe788361eab21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666332.095441:0:15022:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f3600/0x96bbe788361eab21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666332.095464:0:15022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186235520:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788666332.095531:0:15022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666332.095569:0:15022:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28a815480 going to sleep for 11 seconds 00000100:00100000:0.0:1788666332.095720:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186235520 00000100:00100000:0.0:1788666332.095728:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186235520 00000100:00100000:0.0:1788666332.095780:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788666332.095789:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b6079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+15:15022:x1875552186235520:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788666332.095803:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666332.095814:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2bfa7e800/0x96bbe788361eab28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361eab21 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666332.095837:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2bfa7e800/0x96bbe788361eab28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361eab21 expref: 16 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666332.095847:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2bfa7e800/0x96bbe788361eab28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eab21 expref: 16 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666332.095856:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2bfa7e800, rc 0) 00000100:00100000:0.0:1788666332.095894:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b6079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:15022:x1875552186235520:12345-0@lo:101:mount.lustre.0 Request processed in 107us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666332.095900:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788666332.097330:0:15022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186235520:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788666332.097351:0:15022:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f3600/0x96bbe788361eab21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eab28 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666332.097641:0:15022:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f3600/0x96bbe788361eab21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361eab28 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788666332.098321:0:15022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1788666332.101099:0:15022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788666332.101869:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788666332.101916:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788666332.101952:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788666332.102002:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788666332.102054:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788666332.102107:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788666332.102246:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788666332.102283:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788666332.102337:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788666332.102444:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788666332.102481:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788666332.102526:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788666332.102557:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788666332.102669:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788666332.102753:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788666332.102791:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788666332.102822:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788666332.102863:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788666332.102891:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788666332.102919:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788666332.102976:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788666332.103024:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788666332.103079:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788666332.103202:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788666332.103246:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788666332.103277:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788666332.103320:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788666332.103349:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788666332.103502:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788666332.103520:0:15022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1788666332.103770:0:15022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186235648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788666332.103844:0:15022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666332.103973:0:15022:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28a815480 going to sleep for 11 seconds 00000100:00100000:0.0:1788666332.104035:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186235648 00000100:00100000:0.0:1788666332.104042:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186235648 00000100:00100000:0.0:1788666332.104136:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788666332.104146:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b607b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:15022:x1875552186235648:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788666332.104519:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b607b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:15022:x1875552186235648:12345-0@lo:501:mount.lustre.0 Request processed in 373us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666332.104528:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788666332.107035:0:15022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186235648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788666332.107099:0:15022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186235776:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788666332.107187:0:15022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666332.107226:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186235776 00000100:00100000:2.0:1788666332.107233:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186235776 00000100:00100000:2.0:1788666332.107277:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788666332.107286:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b607b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:15022:x1875552186235776:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788666332.107615:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b607b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:15022:x1875552186235776:12345-0@lo:503:mount.lustre.0 Request processed in 329us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666332.107623:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788666332.107678:0:15022:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28a815480 going to sleep for 11 seconds 00000100:00100000:2.0:1788666332.107690:0:15022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186235776:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788666332.109457:0:15022:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788666332.109543:0:15022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186235904:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788666332.114229:0:15022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666332.114291:0:15022:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28a815480 going to sleep for 11 seconds 00000100:00100000:3.0:1788666332.115757:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186235904 00000100:00100000:3.0:1788666332.115770:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186235904 00000100:00100000:3.0:1788666332.115824:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788666332.115833:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b607ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:15022:x1875552186235904:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788666332.116136:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b607ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:15022:x1875552186235904:12345-0@lo:502:mount.lustre.0 Request processed in 302us (1913us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666332.116145:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788666332.117799:0:15022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186235904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788666332.118164:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788666332.118235:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788666332.118272:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788666332.118321:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788666332.118489:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788666332.118544:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788666332.118623:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788666332.118659:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788666332.118715:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788666332.118752:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788666332.118785:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788666332.118831:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788666332.118865:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788666332.118901:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788666332.118947:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788666332.118980:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788666332.119008:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788666332.119067:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788666332.119101:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788666332.120227:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788666332.120309:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788666332.120346:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788666332.120694:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788666332.120744:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788666332.120779:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788666332.120807:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788666332.120852:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788666332.121734:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788666332.121785:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788666332.121846:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788666332.122441:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788666332.122483:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788666332.122509:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788666332.122556:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788666332.122623:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788666332.122672:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788666332.122703:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788666332.122745:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788666332.122821:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788666332.122856:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788666332.122916:0:15022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186236032:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788666332.122985:0:15022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666332.123038:0:15022:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28a815480 going to sleep for 11 seconds 00000100:00100000:1.0:1788666332.123043:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186236032 00000100:00100000:1.0:1788666332.123050:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186236032 00000100:00100000:1.0:1788666332.123170:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788666332.123181:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b607a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:15022:x1875552186236032:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788666332.123473:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b607a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:15022:x1875552186236032:12345-0@lo:502:mount.lustre.0 Request processed in 293us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666332.123480:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788666332.124126:0:15022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186236032:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788666332.124220:0:15022:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788666332.124235:0:15022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788666332.126257:0:15045:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788666332.126274:0:15045:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8ab2857bcd40) 00000020:00000080:2.0:1788666332.126294:0:15045:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788666332.126376:0:15045:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab2b44dd800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788666332.126381:0:15045:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab2b44dd800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788666332.126383:0:15045:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab2b44dd800 3 00010000:00080000:2.0:1788666332.126415:0:15045:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab2bfbf2800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.125@tcp at head 00010000:00010000:2.0:1788666332.130889:0:15045:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788666332.131147:0:15045:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788666332.131189:0:15045:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788666332.131202:0:15045:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x96bbe788361eab36 00000100:00080000:2.0:1788666332.131214:0:15045:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788666332.131222:0:15045:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8ab2bfbf2800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:2.0:1788666332.131261:0:15045:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab2c1ab8a80 x1875552186236160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788666332.131292:0:15045:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788666332.131320:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788666332.131324:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788666332.131344:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788666332.131347:0:467:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788666332.131398:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186236288:0@lo:400:kworker.0 00000100:00100000:2.0:1788666332.131459:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666332.131513:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186236288 00000100:00100000:2.0:1788666332.131520:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186236288 00000100:00100000:3.0:1788666332.131526:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3274:1875552186236160:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788666332.131557:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788666332.131558:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666332.131565:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186236288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666332.131615:0:14341:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788666332.131622:0:14341:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788666332.131631:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186236288:12345-0@lo:400:kworker.0 Request processed in 67us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666332.131638:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788666332.131650:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186236160 00000100:00100000:2.0:1788666332.131653:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186236160 00000100:00100000:2.0:1788666332.131664:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788666332.131668:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3274:x1875552186236160:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788666332.131687:0:14343:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:2.0:1788666332.131715:0:14343:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x96bbe788361eab3d 00000004:00100000:2.0:1788666332.131730:0:14343:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788666332.131758:0:14343:0:(import.c:65:import_set_state_nolock()) ffff8ab284ea5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788666332.131794:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3274:x1875552186236160:12345-0@lo:38:llog_process_th.0 Request processed in 125us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666332.131801:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788666332.131845:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ab2c1ab8a80 x1875552186236160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788666342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666332.131855:0:3274:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788666332.131867:0:3274:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788666332.131873:0:3274:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788666332.131876:0:3274:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788666332.131879:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab2bfbf2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788666332.131885:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3274:1875552186236160:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788666332.131910:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8ab2c1ab9c00 x1875552186236288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666332.131919:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186236288:0@lo:400:kworker.0 00000040:00080000:2.0:1788666332.134434:0:15045:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788666332.134960:0:15022:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788666332.134984:0:15022:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788666332.135010:0:15022:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f3600/0x96bbe788361eab21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eab28 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666332.135031:0:15022:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f3600/0x96bbe788361eab21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eab28 expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788666332.135077:0:15022:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788666332.135083:0:15022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788666332.135086:0:15022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666332.135088:0:15022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666332.135089:0:15022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666332.135090:0:15022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666332.135091:0:15022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788666332.135093:0:15022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666332.135094:0:15022:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788666332.135098:0:15022:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788666332.135100:0:15022:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788666332.135102:0:15022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788666332.135103:0:15022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666332.135104:0:15022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666332.135104:0:15022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666332.135105:0:15022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666332.135106:0:15022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788666332.135107:0:15022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666332.135108:0:15022:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788666332.135144:0:15022:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788666332.135163:0:15022:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186236416:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788666332.135231:0:15022:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666332.135276:0:15022:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab288a8a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666332.135396:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186236416 00000100:00100000:2.0:1788666332.135403:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186236416 00000100:00100000:2.0:1788666332.135447:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788666332.135456:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b6078050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:15022:x1875552186236416:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788666332.135480:0:14334:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788666332.135493:0:14334:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788666332.165242:0:14334:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788666332.165296:0:14334:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788666332.168976:0:14357:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788666332.168987:0:14357:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000100:00100000:2.0:1788666332.171305:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b6078050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:15022:x1875552186236416:12345-0@lo:253:mount.lustre.0 Request processed in 35841us (36065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666332.171319:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788666332.171481:0:15022:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15022:1875552186236416:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788666332.171499:0:15022:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788666332.171502:0:15022:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788666332.171504:0:15022:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788666332.171505:0:15022:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666332.171507:0:15022:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666332.171508:0:15022:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666332.171509:0:15022:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666332.171511:0:15022:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788666332.171513:0:15022:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666332.171514:0:15022:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788666332.171529:0:15022:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1788666332.177322:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab298855800/0x96bbe788361eab44 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666332.177352:0:14357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab2b47e8800/0x96bbe788361eaab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eaaaa expref: 15 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666332.177361:0:14357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab298855800/0x96bbe788361eab44 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666332.177420:0:14357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab2b47e8800/0x96bbe788361eaab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361eaaaa expref: 15 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666332.177436:0:14357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab2b47e8800/0x96bbe788361eaab1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361eaaaa expref: 15 pid: 14333 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666332.177472:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae978a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14357:1875552186236544:0@lo:104: 00000100:00100000:1.0:1788666332.177558:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666332.177629:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2aea25480 going to sleep for 11 seconds 00000100:00100000:2.0:1788666332.177781:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186236544 00000100:00100000:2.0:1788666332.177789:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186236544 00000100:00100000:2.0:1788666332.177846:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788666332.177855:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae979c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+3:14357:x1875552186236544:12345-0@lo:104: 00010000:00010000:2.0:1788666332.177869:0:14325:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f3400/0x96bbe788361eaaaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361eaab1 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666332.177938:0:14325:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788666332.177944:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae979c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+3:14357:x1875552186236544:12345-0@lo:104: Request processed in 91us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666332.177952:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788666332.177973:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666332.177979:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f3400/0x96bbe788361eaaaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361eaab1 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666332.177986:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3400 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:2.0:1788666332.177990:0:14330:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f3400/0x96bbe788361eaaaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361eaab1 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666332.177999:0:14330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f3400/0x96bbe788361eaaaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361eaab1 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788666332.178006:0:14330:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f3400/0x96bbe788361eaaaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361eaab1 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666332.178023:0:14330:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788666332.178051:0:14330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f3400/0x96bbe788361eaaaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361eaab1 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666332.178058:0:14330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788666332.178077:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f3400/0x96bbe788361eaaaa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361eaab1 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666332.178084:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab2b47f3400/0x96bbe788361eaaaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361eaab1 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666332.178113:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666332.178115:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666332.178117:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666332.178217:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3276:1875552186236672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788666332.178249:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666332.178737:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186236672 00000100:00100000:0.0:1788666332.178745:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186236672 00010000:00010000:0.0:1788666332.178773:0:14328:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab2b47e8800/0x96bbe788361eaab1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361eaaaa expref: 16 pid: 14333 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666332.178802:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788666332.178810:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:3276:x1875552186236672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788666332.178822:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666332.178827:0:14328:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab2b47e8800/0x96bbe788361eaab1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361eaaaa expref: 16 pid: 14333 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666332.178838:0:14328:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab2b47e8800/0x96bbe788361eaab1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361eaaaa expref: 16 pid: 14333 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666332.178856:0:14328:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab298855800/0x96bbe788361eab44 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666332.178865:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab298855800/0x96bbe788361eab44 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788666332.178879:0:14328:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009893486s 00010000:00010000:0.0:1788666332.178884:0:14328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab298855800/0x96bbe788361eab44 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666332.178892:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab298855800/0x96bbe788361eab44 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666332.178907:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab298855800/0x96bbe788361eab44 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666332.178914:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab298855800/0x96bbe788361eab44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666332.178919:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855800 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:0.0:1788666332.178924:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab298855800/0x96bbe788361eab44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666332.178931:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab298855800/0x96bbe788361eab44 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666332.178940:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab298855800/0x96bbe788361eab44 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666332.178949:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666332.178995:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:3276:x1875552186236672:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666332.179002:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788666332.179054:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3276:1875552186236672:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788666332.179086:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2b47e8800/0x96bbe788361eaab1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361eaaaa expref: 15 pid: 14333 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666332.179099:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae978a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14357:1875552186236544:0@lo:104: 00010000:00010000:0.0:1788666332.179111:0:14357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab298855800/0x96bbe788361eab44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666332.180260:0:14357:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab298855800/0x96bbe788361eab44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666332.180267:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab298855800/0x96bbe788361eab44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666332.180275:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab298855800/0x96bbe788361eab44 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:3.0:1788666332.186133:0:15022:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788666332.186287:0:15022:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788666332.186441:0:15022:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788666332.186615:0:15022:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788666332.186743:0:15022:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788666332.186924:0:15022:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788666332.188966:0:15022:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788666332.299266:0:15022:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788666332.299274:0:15022:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788666332.299309:0:15022:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788666332.299516:0:15022:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.125@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788666332.299536:0:15022:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788666332.299571:0:15022:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788666332.557667:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666333.578894:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788666334.092463:0:14339:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788666334.092470:0:14339:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff8ab2c1c25000 from 7 10000000:01000000:3.0:1788666334.092474:0:14339:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788666334.092525:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8c00/0x96bbe788361eab4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666334.092537:0:14339:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8c00/0x96bbe788361eab4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666334.092548:0:14339:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8c00/0x96bbe788361eab4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666334.092576:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186236800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788666334.092811:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666334.092865:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab286278300 going to sleep for 11 seconds 00000100:00100000:2.0:1788666334.093231:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186236800 00000100:00100000:2.0:1788666334.093239:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186236800 00000100:00100000:2.0:1788666334.093300:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788666334.093312:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b6078850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+15:14339:x1875552186236800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788666334.093327:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666334.094064:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2b47f3400/0x96bbe788361eab52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361eab4b expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666334.094096:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2b47f3400/0x96bbe788361eab52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361eab4b expref: 16 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666334.094108:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2b47f3400/0x96bbe788361eab52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eab4b expref: 16 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666334.094117:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47f3400, rc 0) 00000100:00100000:2.0:1788666334.094188:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b6078850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:14339:x1875552186236800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 878us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666334.094195:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788666334.094255:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186236800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788666334.094288:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8c00/0x96bbe788361eab4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eab52 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666334.094296:0:14339:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8c00/0x96bbe788361eab4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361eab52 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666334.095455:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186236928:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788666334.095510:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666334.095553:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28619ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788666334.096145:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186236928 00000100:00100000:3.0:1788666334.096154:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186236928 00000100:00100000:3.0:1788666334.096204:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788666334.096213:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b6079450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:14339:x1875552186236928:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788666334.096236:0:14334:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788666334.096255:0:14334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788666334.096258:0:14334:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788666334.096382:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b6079450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:14339:x1875552186236928:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 169us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666334.096390:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788666334.097476:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186236928:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788666334.097565:0:14339:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788666334.097576:0:14339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8c00/0x96bbe788361eab4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eab52 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666334.097606:0:14339:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8c00/0x96bbe788361eab4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eab52 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666334.604185:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666335.627184:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666336.655525:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788666337.171468:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788666337.171475:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788666337.171478:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788666337.171482:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788666337.171517:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788666337.171538:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3276:1875552186237312:0@lo:400:kworker.0 00000100:00100000:0.0:1788666337.171770:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666337.172032:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3277:1875552186237056:0@lo:400:kworker.0 00000100:00100000:2.0:1788666337.172068:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666337.172102:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788666337.172108:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186237184:0@lo:400:kworker.0 00000100:00100000:2.0:1788666337.172131:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666337.172162:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186237312 00000100:00100000:2.0:1788666337.172170:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186237312 00000100:00100000:2.0:1788666337.172221:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186237184 00000100:00100000:2.0:1788666337.172235:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186237184 00000100:00100000:2.0:1788666337.172258:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788666337.172266:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875552186237312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666337.172319:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875552186237312:12345-0@lo:400:kworker.0 Request processed in 53us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666337.172326:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788666337.172342:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788666337.172348:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186237184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666337.172395:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186237184:12345-0@lo:400:kworker.0 Request processed in 48us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666337.172401:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788666337.172439:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2b480ed80 x1875552186237184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666337.172454:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186237184:0@lo:400:kworker.0 00010000:00080000:2.0:1788666337.172482:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2b480f800 x1875552186237312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666337.172491:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3276:1875552186237312:0@lo:400:kworker.0 00000100:00080000:1.0:1788666337.172794:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666337.172865:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186237056 00000100:00100000:0.0:1788666337.172870:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186237056 00000100:00100000:0.0:1788666337.172903:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788666337.172911:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b607bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:3277:x1875552186237056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666337.172970:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b607bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:3277:x1875552186237056:12345-0@lo:400:kworker.0 Request processed in 58us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666337.172985:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788666337.173055:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3277:1875552186237056:0@lo:400:kworker.0 00010000:00010000:0.0:1788666337.682067:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666338.707809:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788666339.084461:0:14373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1788666339.464721:0:15391:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788666339.722825:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666340.758198:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666341.770841:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788666342.283957:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666342.283966:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788666342.283970:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666342.283973:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788666342.284028:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186237568:0@lo:400:kworker.0 00000100:00100000:1.0:1788666342.284115:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666342.284179:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788666342.284186:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186237696:0@lo:400:kworker.0 00000100:00100000:1.0:1788666342.284212:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666342.284396:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3276:1875552186237440:0@lo:400:kworker.0 00000100:00100000:0.0:1788666342.284429:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666342.285051:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186237440 00000100:00100000:1.0:1788666342.285061:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186237440 00000100:00100000:1.0:1788666342.285110:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788666342.285120:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b6079850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:3276:x1875552186237440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666342.285173:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b6079850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:3276:x1875552186237440:12345-0@lo:400:kworker.0 Request processed in 54us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666342.285179:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788666342.285255:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae978000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3276:1875552186237440:0@lo:400:kworker.0 00000100:00100000:2.0:1788666342.285619:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186237568 00000100:00100000:2.0:1788666342.285624:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186237568 00000100:00100000:2.0:1788666342.285758:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186237696 00000100:00100000:2.0:1788666342.285762:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186237696 00000100:00100000:2.0:1788666342.285787:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788666342.285793:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186237568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666342.285838:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186237568:12345-0@lo:400:kworker.0 Request processed in 45us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666342.285865:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788666342.285879:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788666342.285886:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186237696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666342.285918:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae97a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186237696:12345-0@lo:400:kworker.0 Request processed in 34us (1705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666342.285924:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788666342.285946:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788666342.285972:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2ae97b480 x1875552186237696/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666342.285986:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186237696:0@lo:400:kworker.0 00010000:00080000:2.0:1788666342.285999:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2ae978e00 x1875552186237568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666342.286008:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186237568:0@lo:400:kworker.0 00000100:00100000:2.0:1788666342.413512:0:3274:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788666327/real 1788666327] req@ffff8ab2c1ab9880 x1875552186233472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666342 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666342.413550:0:3274:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab2c1ab9880 x1875552186233472/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666342 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666342.413560:0:3274:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788666327/real 1788666327] req@ffff8ab2c1ab8380 x1875552186233600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666342 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666342.413571:0:3274:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8ab2c1ab8380 x1875552186233600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788666342 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788666342.413623:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab2a02ee800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788666342.413648:0:3274:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788666342.413676:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186233472:0@lo:8:kworker.0 00000100:00080000:2.0:1788666342.413682:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab2bf987000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788666342.413689:0:3274:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788666342.413692:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186233600:0@lo:8:kworker.0 00000100:00080000:1.0:1788666342.413827:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666342.413847:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788666342.413850:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab2a02ee800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788666342.413854:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 434 00000100:00080000:1.0:1788666342.413860:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788666342.413867:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8ab2a02ee800 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:1.0:1788666342.413905:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab2ae97a300 x1875552186237952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788666342.413929:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666342.413933:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788666342.413935:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab2bf987000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788666342.413938:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 434 00000100:00080000:1.0:1788666342.413941:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788666342.413944:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ab2bf987000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:1.0:1788666342.413955:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab2ae979180 x1875552186238080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788666342.414001:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788666342.414012:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186238336:0@lo:400:kworker.0 00000100:00100000:1.0:1788666342.414081:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666342.414384:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186238208:0@lo:400:kworker.0 00000100:00100000:0.0:1788666342.414416:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666342.414453:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788666342.414460:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3276:1875552186237824:0@lo:400:kworker.0 00000100:00100000:0.0:1788666342.414492:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666342.414530:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186237824 00000100:00100000:0.0:1788666342.414538:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186237824 00000100:00100000:0.0:1788666342.414601:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788666342.414610:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b6078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:3276:x1875552186237824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666342.414658:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b6078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:3276:x1875552186237824:12345-0@lo:400:kworker.0 Request processed in 49us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666342.414665:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788666342.414712:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3276:1875552186237824:0@lo:400:kworker.0 00000100:00100000:2.0:1788666342.415035:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186238336 00000100:00100000:2.0:1788666342.415040:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186238336 00000100:00100000:2.0:1788666342.415077:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186238208 00000100:00100000:2.0:1788666342.415080:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186238208 00000100:00100000:2.0:1788666342.415098:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788666342.415105:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186238336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666342.415152:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186238336:12345-0@lo:400:kworker.0 Request processed in 47us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666342.415157:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788666342.415169:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788666342.415175:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186238208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666342.415203:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186238208:12345-0@lo:400:kworker.0 Request processed in 28us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666342.415209:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788666342.415237:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2ae97b480 x1875552186238336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666342.415249:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186238336:0@lo:400:kworker.0 00000100:00100000:3.0:1788666342.416013:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186237952:0@lo:8:kworker.0 00000100:00100000:3.0:1788666342.416054:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666342.416139:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186238080:0@lo:8:kworker.0 00000100:00100000:3.0:1788666342.416164:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666342.416427:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186237952 00000100:00100000:2.0:1788666342.416434:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186237952 00000100:00100000:2.0:1788666342.416463:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186238080 00000100:00100000:2.0:1788666342.416466:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186238080 00000100:00100000:2.0:1788666342.416477:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788666342.416497:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3274:x1875552186237952:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788666342.416527:0:15023:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:2.0:1788666342.416559:0:15023:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96bbe788361eab59 00002000:00100000:2.0:1788666342.416572:0:15023:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8ab290a50800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788666342.416603:0:15023:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788666342.416606:0:15023:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788666342.417072:0:15023:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788666342.417096:0:15023:0:(import.c:65:import_set_state_nolock()) ffff8ab290a57000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788666342.417150:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3274:x1875552186237952:12345-0@lo:8:kworker.0 Request processed in 652us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666342.417158:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788666342.417173:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788666342.417178:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3274:x1875552186238080:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788666342.417189:0:15023:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788666342.417214:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3274:x1875552186238080:12345-0@lo:8:kworker.0 Request processed in 34us (1048us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788666342.417219:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788666342.417453:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2ae978e00 x1875552186238208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788666342.417468:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186238208:0@lo:400:kworker.0 00010000:00080000:3.0:1788666342.417956:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2ae97a300 x1875552186237952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788666362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788666342.417967:0:3274:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788666342.417974:0:3274:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788666342.417982:0:3274:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788666342.417988:0:3274:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788666342.417990:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab2a02ee800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788666342.418014:0:3274:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788666342.418020:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186237952:0@lo:8:kworker.0 00000100:00080000:3.0:1788666342.418034:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab2bf987000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788666342.418038:0:3274:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788666342.418041:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186238080:0@lo:8:kworker.0 00000004:00080000:1.0:1788666342.418333:0:14364:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788666342.418358:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14364:1875552186238592:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788666342.418410:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666342.418433:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b7780 going to sleep for 11 seconds 00000100:00100000:1.0:1788666342.418445:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788666342.418453:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186238464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788666342.418485:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666342.418560:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186238464 00000100:00100000:1.0:1788666342.418567:0:15027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186238464 00000100:00100000:1.0:1788666342.418654:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788666342.418663:0:15027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1875552186238464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788666342.418706:0:15027:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666342.418756:0:15027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae978700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3277:x1875552186238464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666342.418763:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788666342.418816:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2ae978a80 x1875552186238464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666342.418833:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae978a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186238464:0@lo:13:osp-pre-0-0.0 00000004:00080000:2.0:1788666342.419108:0:14363:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788666342.419539:0:14363:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 449127958339ns, next at 0ns, rc = 0 00000100:00080000:2.0:1788666342.419605:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788666342.419626:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186238592 00000100:00100000:2.0:1788666342.419633:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186238592 00000100:00100000:2.0:1788666342.419670:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788666342.419680:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14364:x1875552186238592:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788666342.429407:0:15023:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1788666342.429422:0:15023:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788666342.429437:0:15023:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1788666342.451901:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.451914:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eab60 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.451933:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.451937:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.451944:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eab60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.451961:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eab60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.451971:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eab60 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.451979:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eab60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.451996:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666342.452009:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666342.452015:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eab60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.452022:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2e00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666342.452027:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eab60 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.452047:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eab60 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.452065:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eab60 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.452072:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eab60 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.452091:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666342.452092:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666342.452094:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666342.454183:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.454212:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eab67 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.454229:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.454233:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.454239:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eab67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.454252:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eab67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.454262:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eab67 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.454277:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eab67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.454307:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666342.454435:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666342.454445:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eab67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.454457:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2000 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666342.454462:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eab67 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.454485:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eab67 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.454507:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eab67 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.454517:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eab67 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.454538:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.454540:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.454542:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666342.457256:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.457270:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361eab6e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.457288:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.457293:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.457299:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361eab6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.457313:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361eab6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.457323:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361eab6e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.457332:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361eab6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.457357:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666342.457406:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666342.457415:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361eab6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.457425:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3e00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666342.457430:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361eab6e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.457440:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361eab6e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.457459:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361eab6e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.457479:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361eab6e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.457499:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.457502:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.457504:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666342.457853:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.457859:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006109c1e2/0x96bbe788361eab75 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.457874:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.457877:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.457882:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006109c1e2/0x96bbe788361eab75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.457890:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006109c1e2/0x96bbe788361eab75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.457897:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006109c1e2/0x96bbe788361eab75 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.457903:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006109c1e2/0x96bbe788361eab75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.457923:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666342.457963:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666342.457970:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006109c1e2/0x96bbe788361eab75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.457979:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3000 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666342.457984:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006109c1e2/0x96bbe788361eab75 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.457993:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006109c1e2/0x96bbe788361eab75 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.458005:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006109c1e2/0x96bbe788361eab75 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.458013:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006109c1e2/0x96bbe788361eab75 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.458032:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.458035:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.458037:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666342.458317:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.458323:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c121abe/0x96bbe788361eab7c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.458332:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.458335:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.458339:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c121abe/0x96bbe788361eab7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.458348:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c121abe/0x96bbe788361eab7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.458361:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c121abe/0x96bbe788361eab7c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.458366:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c121abe/0x96bbe788361eab7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.458381:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666342.458402:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666342.458409:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c121abe/0x96bbe788361eab7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.458417:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2400 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666342.458421:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c121abe/0x96bbe788361eab7c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.458429:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c121abe/0x96bbe788361eab7c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.458442:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c121abe/0x96bbe788361eab7c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.458450:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c121abe/0x96bbe788361eab7c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.458469:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.458471:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.458473:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666342.458712:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.458717:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002e7964b/0x96bbe788361eab83 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.458723:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.458726:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.458728:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002e7964b/0x96bbe788361eab83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.458734:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002e7964b/0x96bbe788361eab83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.458739:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002e7964b/0x96bbe788361eab83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.458743:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002e7964b/0x96bbe788361eab83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.458766:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666342.458868:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666342.458874:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002e7964b/0x96bbe788361eab83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.458882:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3c00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666342.458894:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002e7964b/0x96bbe788361eab83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.458916:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002e7964b/0x96bbe788361eab83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.458929:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002e7964b/0x96bbe788361eab83 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.458936:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002e7964b/0x96bbe788361eab83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.458955:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.458958:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.458960:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666342.459178:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.459183:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9a3b9cb/0x96bbe788361eab8a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.459192:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.459195:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.459199:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9a3b9cb/0x96bbe788361eab8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.459208:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9a3b9cb/0x96bbe788361eab8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.459216:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9a3b9cb/0x96bbe788361eab8a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.459223:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9a3b9cb/0x96bbe788361eab8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.463672:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788666342.465951:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.465966:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361eab91 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.465985:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.465999:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.466007:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361eab91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.466024:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361eab91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.466035:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361eab91 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.466042:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361eab91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.467467:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788666342.467475:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788666342.467486:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9a3b9cb/0x96bbe788361eab8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.467500:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2800 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666342.467506:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9a3b9cb/0x96bbe788361eab8a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.467517:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9a3b9cb/0x96bbe788361eab8a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.467536:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9a3b9cb/0x96bbe788361eab8a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.467561:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9a3b9cb/0x96bbe788361eab8a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.467618:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666342.467622:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361eab91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.468006:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.468404:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2c00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666342.468408:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361eab91 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.468418:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361eab91 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.468434:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361eab91 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.468442:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361eab91 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.468462:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.468464:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.468466:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666342.469143:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.469153:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eab98 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.469168:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.469173:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.469179:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eab98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.469438:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eab98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.469451:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eab98 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.469466:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eab98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.469494:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666342.469729:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666342.469738:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eab98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.469755:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2e00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666342.469760:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eab98 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.469768:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eab98 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.469784:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eab98 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.469791:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eab98 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.469808:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.469810:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.469812:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666342.470155:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.470162:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eab9f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.470172:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.470177:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.470181:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eab9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.470192:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eab9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.470200:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eab9f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.470345:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eab9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.470371:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666342.470413:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666342.470420:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eab9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.470429:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2000 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666342.470433:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eab9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.470441:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eab9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.470462:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eab9f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.470470:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eab9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.470487:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.470490:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.470494:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666342.470977:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.470984:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eea9a12d/0x96bbe788361eaba6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.471000:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.471004:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.471009:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eea9a12d/0x96bbe788361eaba6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.471019:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eea9a12d/0x96bbe788361eaba6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.471028:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eea9a12d/0x96bbe788361eaba6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.471036:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eea9a12d/0x96bbe788361eaba6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.471059:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666342.471266:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666342.471272:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eea9a12d/0x96bbe788361eaba6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.471280:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3800 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666342.471284:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eea9a12d/0x96bbe788361eaba6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.471292:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eea9a12d/0x96bbe788361eaba6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.471304:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eea9a12d/0x96bbe788361eaba6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.471312:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eea9a12d/0x96bbe788361eaba6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.471469:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.471471:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.471473:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788666342.473979:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788666342.474037:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.474049:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000994341de/0x96bbe788361eabad lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.474065:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.474070:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.474076:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000994341de/0x96bbe788361eabad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.474092:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000994341de/0x96bbe788361eabad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.474114:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000994341de/0x96bbe788361eabad lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.474133:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000994341de/0x96bbe788361eabad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.474163:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666342.474182:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666342.474192:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000994341de/0x96bbe788361eabad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.474202:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2200 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666342.474208:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000994341de/0x96bbe788361eabad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.474217:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000994341de/0x96bbe788361eabad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.474410:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000994341de/0x96bbe788361eabad lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.474420:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000994341de/0x96bbe788361eabad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.474447:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.474449:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.474450:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666342.481539:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.481557:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361eabb4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.481613:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.481620:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.481627:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361eabb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.481640:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361eabb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.481651:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361eabb4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.481659:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361eabb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.481690:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666342.482435:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666342.482445:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361eabb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.482470:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2c00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666342.482476:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361eabb4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.482486:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361eabb4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.482505:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361eabb4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.482512:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008420a788/0x96bbe788361eabb4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.482534:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.482537:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.482539:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666342.483096:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.483105:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9a3b9cb/0x96bbe788361eabbb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.483115:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.483132:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.483138:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9a3b9cb/0x96bbe788361eabbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.483150:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9a3b9cb/0x96bbe788361eabbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.483159:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9a3b9cb/0x96bbe788361eabbb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.483166:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9a3b9cb/0x96bbe788361eabbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.483194:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788666342.483532:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666342.483540:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9a3b9cb/0x96bbe788361eabbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666342.483549:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2800 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:1.0:1788666342.483553:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9a3b9cb/0x96bbe788361eabbb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666342.483562:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9a3b9cb/0x96bbe788361eabbb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666342.483604:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9a3b9cb/0x96bbe788361eabbb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666342.483613:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9a3b9cb/0x96bbe788361eabbb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666342.483638:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666342.483640:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666342.483642:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666342.484780:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.485733:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002e7964b/0x96bbe788361eabc2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.485750:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.485767:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.485773:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002e7964b/0x96bbe788361eabc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.485959:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002e7964b/0x96bbe788361eabc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.485972:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002e7964b/0x96bbe788361eabc2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.485980:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002e7964b/0x96bbe788361eabc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.486012:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788666342.487104:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.487115:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c121abe/0x96bbe788361eabc9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.487128:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.487133:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.487139:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c121abe/0x96bbe788361eabc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.487153:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c121abe/0x96bbe788361eabc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.487164:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c121abe/0x96bbe788361eabc9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.487179:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c121abe/0x96bbe788361eabc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.487206:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788666342.487405:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788666342.487414:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002e7964b/0x96bbe788361eabc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666342.487422:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3c00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:0.0:1788666342.487427:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002e7964b/0x96bbe788361eabc2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666342.487437:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002e7964b/0x96bbe788361eabc2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666342.487459:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002e7964b/0x96bbe788361eabc2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666342.487467:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002e7964b/0x96bbe788361eabc2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666342.487499:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666342.487502:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c121abe/0x96bbe788361eabc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666342.487509:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2400 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:0.0:1788666342.487512:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c121abe/0x96bbe788361eabc9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666342.487520:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c121abe/0x96bbe788361eabc9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666342.487542:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c121abe/0x96bbe788361eabc9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666342.487549:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c121abe/0x96bbe788361eabc9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666342.487555:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666342.487565:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666342.487569:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666342.487571:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666342.491373:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.491389:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006109c1e2/0x96bbe788361eabd0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.491408:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.491413:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.491420:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006109c1e2/0x96bbe788361eabd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.491437:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006109c1e2/0x96bbe788361eabd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.491449:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006109c1e2/0x96bbe788361eabd0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.491457:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006109c1e2/0x96bbe788361eabd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.491484:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788666342.491942:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.491949:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361eabd7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.491964:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.491967:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.491972:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361eabd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.491982:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361eabd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.491990:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361eabd7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.491998:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361eabd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.492015:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788666342.492419:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.492425:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eea9a12d/0x96bbe788361eabde lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.492433:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.492436:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.492440:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eea9a12d/0x96bbe788361eabde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.492447:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eea9a12d/0x96bbe788361eabde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.492465:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eea9a12d/0x96bbe788361eabde lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.492471:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eea9a12d/0x96bbe788361eabde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.492478:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788666342.492744:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788666342.492754:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006109c1e2/0x96bbe788361eabd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.492765:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3000 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666342.492770:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006109c1e2/0x96bbe788361eabd0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.492781:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006109c1e2/0x96bbe788361eabd0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.492810:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006109c1e2/0x96bbe788361eabd0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.492817:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006109c1e2/0x96bbe788361eabd0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.492848:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788666342.492859:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361eabd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.492866:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3e00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666342.492870:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361eabd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.492878:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361eabd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.492889:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361eabd7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.492896:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000deb39bdf/0x96bbe788361eabd7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.492911:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:2.0:1788666342.492913:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788666342.492915:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eea9a12d/0x96bbe788361eabde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.492921:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eabe5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.492943:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f3800 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666342.492943:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.492949:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666342.492950:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eea9a12d/0x96bbe788361eabde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.492957:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eabe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.492964:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eea9a12d/0x96bbe788361eabde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.492970:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eabe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.492983:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eabe5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.492984:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eea9a12d/0x96bbe788361eabde lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.493000:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eabe5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.493002:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eea9a12d/0x96bbe788361eabde lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.493021:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.493026:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666342.493027:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788666342.493032:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eabe5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.493041:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2000 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666342.493045:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eabe5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.493053:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eabe5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.493079:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eabe5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.493086:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5b1b564/0x96bbe788361eabe5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.493104:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.493106:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.493109:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666342.493749:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666342.496060:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.496075:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eabec lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.496092:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.496097:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.496103:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eabec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.496116:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eabec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.496137:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eabec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.496144:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eabec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.496170:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788666342.497271:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.497283:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d37e6d1c/0x96bbe788361eabf3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.497295:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.497307:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.497311:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d37e6d1c/0x96bbe788361eabf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.497323:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d37e6d1c/0x96bbe788361eabf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.497332:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d37e6d1c/0x96bbe788361eabf3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.497340:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d37e6d1c/0x96bbe788361eabf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.497364:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788666342.498162:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788666342.498174:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eabec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666342.498186:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47f2e00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:0.0:1788666342.498191:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eabec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666342.498202:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eabec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666342.498221:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eabec lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666342.498229:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ab9ea34/0x96bbe788361eabec lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666342.498262:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788666342.498266:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d37e6d1c/0x96bbe788361eabf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666342.498273:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7da00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:0.0:1788666342.498276:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d37e6d1c/0x96bbe788361eabf3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666342.498296:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d37e6d1c/0x96bbe788361eabf3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666342.498306:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d37e6d1c/0x96bbe788361eabf3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666342.498313:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d37e6d1c/0x96bbe788361eabf3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666342.498325:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666342.498326:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666342.498328:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.498442:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666342.498558:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.498564:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004df119d0/0x96bbe788361eabfa lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.498880:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.498886:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.498893:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004df119d0/0x96bbe788361eabfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.498907:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004df119d0/0x96bbe788361eabfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.498916:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004df119d0/0x96bbe788361eabfa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.498931:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004df119d0/0x96bbe788361eabfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.498949:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788666342.499447:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.499455:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032d57547/0x96bbe788361eac01 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.499463:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.499467:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.499471:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032d57547/0x96bbe788361eac01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.499480:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032d57547/0x96bbe788361eac01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.499489:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032d57547/0x96bbe788361eac01 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.499495:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032d57547/0x96bbe788361eac01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.499773:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788666342.501774:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.501865:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019589fe1/0x96bbe788361eac08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.501894:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.501899:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.501906:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019589fe1/0x96bbe788361eac08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.501922:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019589fe1/0x96bbe788361eac08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.501933:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019589fe1/0x96bbe788361eac08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.501941:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019589fe1/0x96bbe788361eac08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.502008:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788666342.502018:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004df119d0/0x96bbe788361eabfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.502026:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7d000 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666342.502032:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004df119d0/0x96bbe788361eabfa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.502040:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004df119d0/0x96bbe788361eabfa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.502058:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004df119d0/0x96bbe788361eabfa lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.502066:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004df119d0/0x96bbe788361eabfa lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.502106:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788666342.502110:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032d57547/0x96bbe788361eac01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.502116:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7c200 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666342.502129:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032d57547/0x96bbe788361eac01 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.502137:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032d57547/0x96bbe788361eac01 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.502148:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032d57547/0x96bbe788361eac01 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.502156:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032d57547/0x96bbe788361eac01 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.502169:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666342.502173:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019589fe1/0x96bbe788361eac08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.502179:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7cc00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666342.502182:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019589fe1/0x96bbe788361eac08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.502201:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019589fe1/0x96bbe788361eac08 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.502213:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019589fe1/0x96bbe788361eac08 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.502221:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.502223:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666342.502226:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666342.502413:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666342.503056:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788666342.503065:0:15023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019589fe1/0x96bbe788361eac08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788666342.504214:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.504226:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac27cb5d/0x96bbe788361eac0f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.504241:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.504246:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.504252:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac27cb5d/0x96bbe788361eac0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.504335:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac27cb5d/0x96bbe788361eac0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.504346:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac27cb5d/0x96bbe788361eac0f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.504354:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac27cb5d/0x96bbe788361eac0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.504462:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666342.504470:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac27cb5d/0x96bbe788361eac0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.504478:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7dc00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666342.504527:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac27cb5d/0x96bbe788361eac0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.504537:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac27cb5d/0x96bbe788361eac0f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666342.504552:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac27cb5d/0x96bbe788361eac0f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.504673:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788666342.504679:0:15023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac27cb5d/0x96bbe788361eac0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666342.505014:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666342.505241:0:15023:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666342.505248:0:15023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffae23de/0x96bbe788361eac16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.505257:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1788666342.505260:0:15023:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666342.505265:0:15023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffae23de/0x96bbe788361eac16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.505275:0:15023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffae23de/0x96bbe788361eac16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.505571:0:15023:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffae23de/0x96bbe788361eac16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.505604:0:15023:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffae23de/0x96bbe788361eac16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666342.505623:0:15023:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788666342.505944:0:15023:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00010000:00010000:1.0:1788666342.506023:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666342.506031:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffae23de/0x96bbe788361eac16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666342.506041:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7ce00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:1.0:1788666342.506047:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffae23de/0x96bbe788361eac16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666342.506057:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae97aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14364:x1875552186238592:12345-0@lo:5:osp-pre-0-0.0 Request processed in 86374us (87640us total) trans 0 rc 0/0 00010000:00010000:1.0:1788666342.506060:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffae23de/0x96bbe788361eac16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666342.506071:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788666342.506083:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffae23de/0x96bbe788361eac16 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666342.506094:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffae23de/0x96bbe788361eac16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666342.506133:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666342.506135:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666342.506137:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666342.506186:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14364:1875552186238592:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788666342.506214:0:14364:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788666342.506263:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14364:1875552186238720:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788666342.506300:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666342.506361:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b7780 going to sleep for 11 seconds 00000100:00100000:3.0:1788666342.506388:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186238720 00000100:00100000:3.0:1788666342.506395:0:15026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186238720 00000100:00100000:3.0:1788666342.506560:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788666342.506605:0:15026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14364:x1875552186238720:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788666342.506649:0:15026:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:0.0:1788666342.508116:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666342.508122:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666342.508125:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666342.525539:0:15026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae978a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14364:x1875552186238720:12345-0@lo:5:osp-pre-0-0.0 Request processed in 18952us (19228us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788666342.525553:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788666342.526243:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14364:1875552186238720:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788666342.526262:0:14364:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1788666342.797262:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788666342.937335:0:6678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788666342.937351:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:0.0:1788666343.819305:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666344.843576:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666345.867205:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666346.891784:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788666347.621177:0:15744:0:(obd_mount.c:921:lmd_print()) mount data: 00000020:01000004:0.0:1788666347.621182:0:15744:0:(obd_mount.c:924:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788666347.621506:0:15744:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8ab2ae320000 00000020:01000004:0.0:1788666347.621523:0:15744:0:(tgt_mount.c:2508:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788666347.621536:0:15744:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788666347.621551:0:15744:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8ab2c19b19c0) 00000020:00000080:0.0:1788666347.621568:0:15744:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788666347.641520:0:15744:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788666347.642058:0:15744:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788666347.643218:0:15744:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788666347.643526:0:15744:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1788666347.643922:0:15744:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788666347.644410:0:15744:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 477: rc = 0 00100000:10000000:1.0:1788666347.644504:0:15744:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 477: rc = 0 00100000:10000000:1.0:1788666347.644775:0:15744:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 477: rc = 0 00100000:10000000:1.0:1788666347.646095:0:15744:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 80: rc = 0 00100000:10000000:1.0:1788666347.647887:0:15744:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 80: rc = 0 00100000:10000000:1.0:1788666347.649087:0:15744:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 80: rc = 0 00100000:10000000:1.0:1788666347.649402:0:15744:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 80: rc = 0 00100000:10000000:1.0:1788666347.649716:0:15744:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 80: rc = 0 00100000:10000000:1.0:1788666347.649996:0:15744:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 80: rc = 0 00000020:00000080:1.0:1788666347.650623:0:15744:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788666347.650636:0:15744:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788666347.650650:0:15744:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x96bbe788361eac24 00000020:01000004:1.0:1788666347.650658:0:15744:0:(tgt_mount.c:2593:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788666347.650680:0:15744:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.125@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788666347.650684:0:15744:0:(mgc_request.c:1069:mgc_set_info_async()) InitRecov MGC192.168.201.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788666347.650700:0:15744:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788666347.650724:0:15744:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788666347.650728:0:15744:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.125@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788666347.667066:0:15744:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.125@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788666347.667477:0:15744:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.125@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788666347.667483:0:15744:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788666347.667485:0:15744:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788666347.667486:0:15744:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666347.667487:0:15744:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666347.667488:0:15744:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666347.667489:0:15744:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666347.667491:0:15744:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788666347.667493:0:15744:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666347.667494:0:15744:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788666347.667498:0:15744:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788666347.667500:0:15744:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788666347.667502:0:15744:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788666347.667503:0:15744:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666347.667504:0:15744:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666347.667505:0:15744:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666347.667506:0:15744:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666347.667507:0:15744:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788666347.667508:0:15744:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666347.667509:0:15744:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788666347.667773:0:15744:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788666347.667797:0:15744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186238848:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788666347.667882:0:15744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666347.667951:0:15744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2c1b6b240 going to sleep for 11 seconds 00000100:00100000:0.0:1788666347.668372:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186238848 00000100:00100000:0.0:1788666347.668382:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186238848 00000100:00100000:0.0:1788666347.668489:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788666347.668499:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b607a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:15744:x1875552186238848:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788666347.668530:0:14335:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788666347.668533:0:14335:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788666347.668537:0:14335:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788666347.678196:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b607a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:15744:x1875552186238848:12345-0@lo:253:mount.lustre.0 Request processed in 9688us (10303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666347.678213:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788666347.678440:0:15744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186238848:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788666347.678457:0:15744:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788666347.678460:0:15744:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788666347.678462:0:15744:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788666347.678464:0:15744:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788666347.678465:0:15744:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788666347.678466:0:15744:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788666347.678467:0:15744:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788666347.678469:0:15744:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788666347.678471:0:15744:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788666347.678472:0:15744:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788666347.678494:0:15744:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8ab2ae320000 from lustre-OST0001 10000000:01000000:1.0:1788666347.678522:0:15744:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788666347.678524:0:15744:0:(mgc_request.c:327:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788666347.678533:0:15744:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8ab2b4820000 local copy 00010000:00010000:1.0:1788666347.678543:0:15744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2bfa7f000/0x96bbe788361ea9d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361ea9d8 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666347.678877:0:15744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186238976:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788666347.678921:0:15744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666347.678955:0:15744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28619ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788666347.679173:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186238976 00000100:00100000:2.0:1788666347.679181:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186238976 00000100:00100000:2.0:1788666347.679240:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788666347.679250:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b607a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:15744:x1875552186238976:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788666347.679566:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b607a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:15744:x1875552186238976:12345-0@lo:501:mount.lustre.0 Request processed in 317us (643us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788666347.679614:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788666347.680400:0:15744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186238976:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788666347.680436:0:15744:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788666347.681077:0:15744:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788666347.681089:0:15744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2bfa7f000/0x96bbe788361ea9d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361ea9d8 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666347.681481:0:15744:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2bfa7f000/0x96bbe788361ea9d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361ea9d8 expref: -99 pid: 14323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666347.681528:0:15744:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8ab2ae320000 10000000:01000000:1.0:1788666347.681534:0:15744:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788666347.681540:0:15744:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788666347.681543:0:15744:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788666347.681548:0:15744:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788666347.681550:0:15744:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788666347.681616:0:15744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab298854e00/0x96bbe788361eac2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666347.681626:0:15744:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab298854e00/0x96bbe788361eac2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666347.681637:0:15744:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab298854e00/0x96bbe788361eac2b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666347.681660:0:15744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186239104:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788666347.681722:0:15744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666347.681774:0:15744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28619ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788666347.681976:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186239104 00000100:00100000:3.0:1788666347.681983:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186239104 00000100:00100000:3.0:1788666347.682026:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788666347.682035:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b6079c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:15744:x1875552186239104:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788666347.682055:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666347.682069:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2b47e9400/0x96bbe788361eac32 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361eac2b expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.682092:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2b47e9400/0x96bbe788361eac32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361eac2b expref: 17 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.682114:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2b47e9400/0x96bbe788361eac32 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eac2b expref: 17 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.682123:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e9400, rc 0) 00000100:00100000:3.0:1788666347.682169:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b6079c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+17:15744:x1875552186239104:12345-0@lo:101:mount.lustre.0 Request processed in 135us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666347.682176:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788666347.682457:0:15744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186239104:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788666347.682483:0:15744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab298854e00/0x96bbe788361eac2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eac32 expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666347.682492:0:15744:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab298854e00/0x96bbe788361eac2b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361eac32 expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788666347.683201:0:15744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788666347.684276:0:15744:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788666347.684513:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788666347.684565:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788666347.684644:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788666347.684706:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788666347.684757:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788666347.684796:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788666347.684859:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788666347.684868:0:15744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788666347.684949:0:15744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186239232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788666347.685012:0:15744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666347.685057:0:15744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28619e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788666347.685424:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186239232 00000100:00100000:3.0:1788666347.685435:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186239232 00000100:00100000:3.0:1788666347.685490:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788666347.685498:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c10b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+17:15744:x1875552186239232:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666347.685921:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c10b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+17:15744:x1875552186239232:12345-0@lo:501:mount.lustre.0 Request processed in 422us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666347.685930:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788666347.688205:0:15744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186239232:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788666347.688380:0:15744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186239360:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788666347.688463:0:15744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666347.688792:0:15744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28619e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788666347.689450:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186239360 00000100:00100000:2.0:1788666347.689459:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186239360 00000100:00100000:3.0:1788666347.689698:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788666347.689709:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c10b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+17:15744:x1875552186239360:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788666347.690180:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c10b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+17:15744:x1875552186239360:12345-0@lo:503:mount.lustre.0 Request processed in 471us (1714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666347.690188:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788666347.690501:0:15744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186239360:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788666347.691442:0:15744:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788666347.691533:0:15744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186239488:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788666347.692183:0:15744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666347.692338:0:15744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28619e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788666347.692411:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186239488 00000100:00100000:2.0:1788666347.692420:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186239488 00000100:00100000:2.0:1788666347.692475:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788666347.692485:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c10ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+17:15744:x1875552186239488:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788666347.693023:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c10ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+17:15744:x1875552186239488:12345-0@lo:502:mount.lustre.0 Request processed in 537us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666347.693032:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788666347.693869:0:15744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186239488:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788666347.694986:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788666347.695076:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788666347.695305:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788666347.695366:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788666347.695407:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788666347.695447:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788666347.695525:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788666347.695573:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788666347.695653:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788666347.695708:0:15744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186239616:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788666347.695805:0:15744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666347.695855:0:15744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28619e000 going to sleep for 11 seconds 00000100:00100000:3.0:1788666347.696901:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186239616 00000100:00100000:3.0:1788666347.696923:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186239616 00000100:00100000:3.0:1788666347.696986:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788666347.696995:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c10ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+17:15744:x1875552186239616:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788666347.697388:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c10ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+17:15744:x1875552186239616:12345-0@lo:502:mount.lustre.0 Request processed in 394us (1583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666347.697397:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788666347.697519:0:15744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186239616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788666347.697836:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788666347.697853:0:15744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788666347.702531:0:15745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788666347.702557:0:15745:0:(obd_mount.c:959:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788666347.702565:0:15745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788666347.702568:0:15745:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788666347.702574:0:15745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788666347.702620:0:15745:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8ab2a0ca99c0) 00000020:00000080:1.0:1788666347.702645:0:15745:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788666347.702661:0:15745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788666347.702774:0:15745:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab2ae320000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788666347.702785:0:15745:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788666347.702793:0:15745:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x96bbe788361eac40 00010000:00010000:0.0:1788666347.713968:0:15745:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1788666347.714820:0:15745:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1788666347.719313:0:15745:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1788666347.727494:0:15745:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788666347.727509:0:15745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788666347.727516:0:15745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666347.727518:0:15745:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788666347.727521:0:15745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788666347.727525:0:15745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666347.727526:0:15745:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788666347.727529:0:15745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788666347.727530:0:15745:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788666347.727533:0:15745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788666347.727535:0:15745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666347.727536:0:15745:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788666347.727539:0:15745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788666347.727541:0:15745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666347.727549:0:15745:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788666347.727553:0:15745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788666347.727641:0:15745:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788666347.727645:0:15745:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788666347.727647:0:15745:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788666347.727650:0:15745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788666347.727860:0:15744:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788666347.727887:0:15744:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788666347.727913:0:15744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab298854e00/0x96bbe788361eac2b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eac32 expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666347.727925:0:15744:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab298854e00/0x96bbe788361eac2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eac32 expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666347.727934:0:15744:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff8ab2ae320000 from 1 10000000:01000000:2.0:1788666347.727937:0:15744:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788666347.727977:0:15744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7de00/0x96bbe788361eac47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666347.727986:0:15744:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7de00/0x96bbe788361eac47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666347.727996:0:15744:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7de00/0x96bbe788361eac47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666347.728030:0:15744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186239744:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788666347.728103:0:15744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666347.728143:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186239744 00000100:00100000:2.0:1788666347.728151:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186239744 00000100:00100000:2.0:1788666347.728193:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788666347.728202:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c10bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+17:15744:x1875552186239744:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788666347.728218:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666347.728231:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361eac4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361eac47 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666347.728254:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361eac4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361eac47 expref: 18 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666347.728265:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361eac4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eac47 expref: 18 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666347.728274:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2a1d7cc00, rc 0) 00000100:00100000:2.0:1788666347.728307:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c10bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+18:15744:x1875552186239744:12345-0@lo:101:mount.lustre.0 Request processed in 105us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666347.728313:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788666347.728359:0:15744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab288a8a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788666347.728382:0:15744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186239744:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788666347.728396:0:15744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7de00/0x96bbe788361eac47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eac4e expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666347.728406:0:15744:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7de00/0x96bbe788361eac47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361eac4e expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788666347.728972:0:15744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788666347.729317:0:15744:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788666347.729572:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788666347.729649:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788666347.729713:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788666347.729721:0:15744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788666347.729815:0:15744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186239872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788666347.729868:0:15744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666347.729920:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186239872 00000100:00100000:2.0:1788666347.729927:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186239872 00000100:00100000:2.0:1788666347.729966:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788666347.729975:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c10bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+18:15744:x1875552186239872:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788666347.730154:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c10bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+18:15744:x1875552186239872:12345-0@lo:501:mount.lustre.0 Request processed in 179us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666347.730161:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788666347.730193:0:15744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab288a8a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788666347.730210:0:15744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186239872:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788666347.730242:0:15744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186240000:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788666347.730280:0:15744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666347.730303:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186240000 00000100:00100000:2.0:1788666347.730306:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186240000 00000100:00100000:2.0:1788666347.730328:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788666347.730334:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c10bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+18:15744:x1875552186240000:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788666347.730463:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c10bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+18:15744:x1875552186240000:12345-0@lo:503:mount.lustre.0 Request processed in 129us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666347.730480:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788666347.730513:0:15744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab288a8a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788666347.730524:0:15744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186240000:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788666347.740819:0:15744:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788666347.740938:0:15744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186240128:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788666347.741039:0:15744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666347.741234:0:15744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b7900 going to sleep for 11 seconds 00000100:00100000:3.0:1788666347.751213:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186240128 00000100:00100000:3.0:1788666347.752795:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186240128 00000100:00100000:3.0:1788666347.752873:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788666347.752883:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c10bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+18:15744:x1875552186240128:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788666347.755167:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c10bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+18:15744:x1875552186240128:12345-0@lo:502:mount.lustre.0 Request processed in 2213us (14056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666347.755185:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788666347.757433:0:15744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186240128:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788666347.757865:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788666347.757939:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788666347.757991:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788666347.758030:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788666347.758068:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788666347.758136:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788666347.758174:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788666347.758209:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788666347.758286:0:15744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186240256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788666347.758371:0:15744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666347.758429:0:15744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b7900 going to sleep for 11 seconds 00000100:00100000:3.0:1788666347.759033:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186240256 00000100:00100000:3.0:1788666347.759043:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186240256 00000100:00100000:3.0:1788666347.759109:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788666347.759122:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b60c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+18:15744:x1875552186240256:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788666347.760120:0:15744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186240256:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788666347.760309:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788666347.760325:0:15744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000100:00100000:3.0:1788666347.761079:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b60c2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+18:15744:x1875552186240256:12345-0@lo:502:mount.lustre.0 Request processed in 457us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666347.761098:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000020:01000000:3.0:1788666347.763048:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666347.763061:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666347.763064:0:15749:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788666347.763071:0:15749:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab2ae320000 00000020:00000080:3.0:1788666347.763074:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788666347.763082:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666347.763085:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666347.763086:0:15749:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788666347.763374:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666347.763378:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666347.763379:0:15749:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788666347.763383:0:15749:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8ab2ae320000 00000020:00000080:3.0:1788666347.763385:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788666347.763440:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666347.763444:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666347.763445:0:15749:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788666347.763448:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788666347.763450:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666347.763452:0:15749:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788666347.763455:0:15749:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8ab2ae320000 00000020:00000080:3.0:1788666347.763457:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788666347.763496:0:15749:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788666347.763500:0:15749:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788666347.763501:0:15749:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788666347.763505:0:15749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788666347.764042:0:15744:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788666347.764069:0:15744:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788666347.764187:0:15744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7de00/0x96bbe788361eac47 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eac4e expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666347.764216:0:15744:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7de00/0x96bbe788361eac47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eac4e expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666347.764402:0:15744:0:(mgc_request.c:1942:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788666347.764406:0:15744:0:(mgc_request.c:327:config_log_add()) add config log lustre-client-ffff8ab2ae320000 10000000:01000000:2.0:1788666347.764409:0:15744:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8ab2ae320000 10000000:01000000:2.0:1788666347.764413:0:15744:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788666347.764419:0:15744:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-client-ffff8ab2ae320000 from 1 10000000:01000000:2.0:1788666347.764422:0:15744:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788666347.764460:0:15744:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7dc00/0x96bbe788361eac55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666347.764467:0:15744:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7dc00/0x96bbe788361eac55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666347.764478:0:15744:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7dc00/0x96bbe788361eac55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666347.764503:0:15744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186240384:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788666347.764729:0:15744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666347.764817:0:15744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b7180 going to sleep for 11 seconds 00000100:00100000:3.0:1788666347.764961:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186240384 00000100:00100000:3.0:1788666347.764969:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186240384 00000100:00100000:3.0:1788666347.765057:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788666347.765067:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b60c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+18:15744:x1875552186240384:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788666347.765082:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666347.765164:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2b47e9600/0x96bbe788361eac5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361eac55 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.765191:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2b47e9600/0x96bbe788361eac5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361eac55 expref: 19 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.765202:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2b47e9600/0x96bbe788361eac5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eac55 expref: 19 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.765211:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e9600, rc 0) 00000100:00100000:3.0:1788666347.765472:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b60c1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:15744:x1875552186240384:12345-0@lo:101:mount.lustre.0 Request processed in 404us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666347.765480:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788666347.765561:0:15744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186240384:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788666347.765609:0:15744:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7dc00/0x96bbe788361eac55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eac5c expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666347.765620:0:15744:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7dc00/0x96bbe788361eac55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361eac5c expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788666347.766958:0:15744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788666347.767990:0:15744:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788666347.768814:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788666347.768876:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788666347.768983:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788666347.769037:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788666347.769073:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788666347.769205:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788666347.769381:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788666347.769440:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788666347.769497:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788666347.769534:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788666347.769569:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788666347.770000:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788666347.770046:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788666347.770086:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788666347.770369:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788666347.770418:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788666347.770467:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788666347.770527:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788666347.770568:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788666347.770920:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788666347.770999:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788666347.771036:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788666347.771071:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788666347.771422:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788666347.771466:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788666347.771508:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788666347.772215:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788666347.772410:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788666347.772442:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788666347.772510:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788666347.772549:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788666347.772783:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788666347.772840:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788666347.772968:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788666347.773015:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788666347.773083:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788666347.773235:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788666347.773496:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788666347.773505:0:15744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788666347.773844:0:15744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186240512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788666347.774038:0:15744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666347.774238:0:15744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2885b7180 going to sleep for 11 seconds 00000100:00100000:3.0:1788666347.774489:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186240512 00000100:00100000:3.0:1788666347.774499:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186240512 00000100:00100000:3.0:1788666347.774622:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788666347.774634:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b60c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:15744:x1875552186240512:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788666347.774965:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b60c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:15744:x1875552186240512:12345-0@lo:501:mount.lustre.0 Request processed in 333us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666347.774974:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788666347.775438:0:15744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186240512:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788666347.775494:0:15744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186240640:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788666347.775544:0:15744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666347.775974:0:15744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab281253480 going to sleep for 11 seconds 00000100:00100000:2.0:1788666347.776025:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186240640 00000100:00100000:2.0:1788666347.776032:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186240640 00000100:00100000:2.0:1788666347.776074:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788666347.776083:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b60c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:15744:x1875552186240640:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788666347.776493:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b60c0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:15744:x1875552186240640:12345-0@lo:503:mount.lustre.0 Request processed in 410us (947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666347.776501:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788666347.777767:0:15744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186240640:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788666347.784298:0:15744:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788666347.784404:0:15744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186240768:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788666347.784501:0:15744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666347.784566:0:15744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a4282780 going to sleep for 11 seconds 00000100:00100000:0.0:1788666347.785206:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186240768 00000100:00100000:0.0:1788666347.785215:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186240768 00000100:00100000:0.0:1788666347.785268:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788666347.785279:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b60c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:15744:x1875552186240768:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788666347.785638:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b60c2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:15744:x1875552186240768:12345-0@lo:502:mount.lustre.0 Request processed in 359us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666347.785647:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788666347.785684:0:15744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186240768:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788666347.791826:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788666347.791929:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788666347.791966:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788666347.792012:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788666347.792047:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788666347.797040:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788666347.797209:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788666347.797258:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788666347.797340:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788666347.797379:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788666347.797413:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788666347.797466:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788666347.797503:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788666347.797537:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788666347.797651:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788666347.797693:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788666347.797729:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788666347.797796:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788666347.797847:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788666347.797882:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788666347.797932:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788666347.797970:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788666347.798006:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788666347.798053:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788666347.798090:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788666347.798122:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788666347.798173:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788666347.798209:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788666347.798264:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788666347.798316:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788666347.798352:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788666347.798384:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788666347.798420:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788666347.798468:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788666347.798505:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788666347.798552:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788666347.798619:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788666347.798656:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788666347.798718:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788666347.798771:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788666347.798825:0:15744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186240896:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788666347.798908:0:15744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666347.798964:0:15744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2c1b6b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666347.800233:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186240896 00000100:00100000:2.0:1788666347.800247:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186240896 00000100:00100000:2.0:1788666347.800305:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788666347.800316:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a088a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:15744:x1875552186240896:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788666347.800629:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a088a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:15744:x1875552186240896:12345-0@lo:502:mount.lustre.0 Request processed in 314us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666347.800638:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788666347.810236:0:15744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186240896:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788666347.810434:0:15744:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788666347.810455:0:15744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788666347.815441:0:15754:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788666347.815477:0:15754:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8ab181c93380) 00000020:00000080:3.0:1788666347.815506:0:15754:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788666347.815612:0:15754:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8ab2ae320000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788666347.815618:0:15754:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8ab2ae320000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788666347.815620:0:15754:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8ab2ae320000 3 00010000:00080000:3.0:1788666347.815655:0:15754:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8ab2b482b000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.125@tcp at head 00010000:00010000:3.0:1788666347.817477:0:15754:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1788666347.825506:0:15754:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788666347.825560:0:15754:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788666347.825577:0:15754:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x96bbe788361eac6a 00000100:00080000:1.0:1788666347.825603:0:15754:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788666347.825610:0:15754:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8ab2b482b000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:1.0:1788666347.825648:0:15754:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab2ae979880 x1875552186241024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788666347.825687:0:15754:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788666347.825761:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788666347.825766:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788666347.825768:0:38:0:(import.c:65:import_set_state_nolock()) ffff8ab2bf987000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788666347.825772:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 449 00000100:00080000:1.0:1788666347.825775:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788666347.825779:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ab2bf987000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:1.0:1788666347.825792:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab2ae97b100 x1875552186241280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788666347.825851:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186241536:0@lo:400:kworker.0 00000100:00100000:1.0:1788666347.825933:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666347.826248:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186241152:0@lo:400:kworker.0 00000100:00100000:2.0:1788666347.826291:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666347.826323:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788666347.826330:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186241408:0@lo:400:kworker.0 00000100:00100000:2.0:1788666347.826353:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666347.826386:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186241536 00000100:00100000:2.0:1788666347.826392:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186241536 00000100:00100000:2.0:1788666347.826459:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186241408 00000100:00100000:2.0:1788666347.826462:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186241408 00000100:00100000:2.0:1788666347.826486:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788666347.826494:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae97a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186241536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666347.826549:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae97a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186241536:12345-0@lo:400:kworker.0 Request processed in 56us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666347.826556:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788666347.826576:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788666347.826643:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186241408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666347.826678:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186241408:12345-0@lo:400:kworker.0 Request processed in 36us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666347.826684:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788666347.826702:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186241152 00000100:00100000:2.0:1788666347.826705:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186241152 00000100:00100000:2.0:1788666347.826732:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788666347.826739:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186241152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666347.826781:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186241152:12345-0@lo:400:kworker.0 Request processed in 43us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666347.826788:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788666347.826806:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788666347.826810:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788666347.826861:0:3275:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2ae97b800 x1875552186241408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666347.826876:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186241408:0@lo:400:kworker.0 00000100:00100000:2.0:1788666347.826888:0:3275:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788666347.826903:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186241152:0@lo:400:kworker.0 00010000:00080000:2.0:1788666347.826930:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2ae979180 x1875552186241536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666347.826938:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186241536:0@lo:400:kworker.0 00000100:00100000:2.0:1788666347.828281:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3274:1875552186241024:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788666347.828352:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666347.828395:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186241280:0@lo:8:kworker.0 00000100:00100000:2.0:1788666347.828422:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666347.828459:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186241024 00000100:00100000:2.0:1788666347.828466:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186241024 00000100:00100000:2.0:1788666347.828504:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788666347.828511:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3274:x1875552186241024:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788666347.828542:0:14343:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:2.0:1788666347.828605:0:14343:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x96bbe788361eac71 00000004:00100000:2.0:1788666347.828620:0:14343:0:(mdt_handler.c:7298:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788666347.828655:0:14343:0:(import.c:65:import_set_state_nolock()) ffff8ab2bfbf2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788666347.828704:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3274:x1875552186241024:12345-0@lo:38:llog_process_th.0 Request processed in 192us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666347.828711:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788666347.828733:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186241280 00000100:00100000:2.0:1788666347.828761:0:15026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186241280 00000100:00100000:2.0:1788666347.828784:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788666347.828789:0:15026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3274:x1875552186241280:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788666347.828827:0:15026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1abb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3274:x1875552186241280:12345-0@lo:8:kworker.0 Request processed in 37us (404us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788666347.828833:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788666347.828867:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8ab2ae979880 x1875552186241024/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788666357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666347.828877:0:3274:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788666347.828886:0:3274:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788666347.828895:0:3274:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788666347.828901:0:3274:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788666347.828904:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab2b482b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788666347.828910:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3274:1875552186241024:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788666347.828921:0:3274:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788666347.828924:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab2bf987000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788666347.828927:0:3274:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788666347.828930:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186241280:0@lo:8:kworker.0 00000040:00080000:1.0:1788666347.830498:0:15754:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788666347.830957:0:15744:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788666347.830994:0:15744:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788666347.831188:0:15744:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7dc00/0x96bbe788361eac55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eac5c expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.831202:0:15744:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7dc00/0x96bbe788361eac55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eac5c expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788666347.831265:0:15744:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788666347.831268:0:15744:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788666347.831269:0:15744:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666347.831270:0:15744:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666347.831272:0:15744:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666347.831273:0:15744:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666347.831276:0:15744:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788666347.831278:0:15744:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666347.831279:0:15744:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788666347.831284:0:15744:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1788666347.831286:0:15744:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788666347.831287:0:15744:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788666347.831289:0:15744:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666347.831290:0:15744:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666347.831291:0:15744:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666347.831292:0:15744:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666347.831293:0:15744:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788666347.831294:0:15744:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666347.831296:0:15744:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788666347.831325:0:15744:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788666347.831351:0:15744:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186241664:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788666347.831448:0:15744:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666347.831504:0:15744:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2856390c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666347.834096:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186241664 00000100:00100000:2.0:1788666347.834120:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186241664 00000100:00100000:2.0:1788666347.834205:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788666347.834218:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a088b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:15744:x1875552186241664:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788666347.834275:0:14334:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788666347.834291:0:14334:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788666347.877934:0:14334:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788666347.877958:0:14334:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1788666347.878051:0:14357:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788666347.878057:0:14357:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788666347.878082:0:14357:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab2bfa7ea00/0x96bbe788361eac78 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666347.878117:0:14357:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab2b47f3400/0x96bbe788361eab52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eab4b expref: 19 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666347.878127:0:14357:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab2bfa7ea00/0x96bbe788361eac78 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666347.878181:0:14357:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab2b47f3400/0x96bbe788361eab52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361eab4b expref: 19 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666347.878196:0:14357:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab2b47f3400/0x96bbe788361eab52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361eab4b expref: 19 pid: 14333 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666347.878212:0:14357:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14357:1875552186241792:0@lo:104: 00000100:00100000:0.0:1788666347.878319:0:14357:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666347.878374:0:14357:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28a815c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788666347.878514:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186241792 00000100:00100000:3.0:1788666347.878523:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186241792 00000100:00100000:3.0:1788666347.878603:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788666347.878613:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+3:14357:x1875552186241792:12345-0@lo:104: 00010000:00010000:3.0:1788666347.878627:0:14324:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8c00/0x96bbe788361eab4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361eab52 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.878688:0:14324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788666347.878695:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+3:14357:x1875552186241792:12345-0@lo:104: Request processed in 84us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666347.878702:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788666347.878730:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666347.878738:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8c00/0x96bbe788361eab4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361eab52 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.878757:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e8c00 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:3.0:1788666347.878761:0:14329:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8c00/0x96bbe788361eab4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361eab52 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.878771:0:14329:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8c00/0x96bbe788361eab4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361eab52 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788666347.878778:0:14329:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8c00/0x96bbe788361eab4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361eab52 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666347.878784:0:14329:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788666347.878818:0:14329:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8c00/0x96bbe788361eab4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361eab52 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.878825:0:14329:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788666347.878854:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8c00/0x96bbe788361eab4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361eab52 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.878861:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8c00/0x96bbe788361eab4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361eab52 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.878880:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666347.878882:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666347.878884:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666347.878897:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b456df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3278:1875552186241920:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788666347.878931:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666347.878970:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186241920 00000100:00100000:3.0:1788666347.878975:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186241920 00010000:00010000:3.0:1788666347.878993:0:14328:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab2b47f3400/0x96bbe788361eab52 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361eab4b expref: 20 pid: 14333 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666347.879016:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788666347.879022:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+20:3278:x1875552186241920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788666347.879033:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666347.879038:0:14328:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab2b47f3400/0x96bbe788361eab52 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361eab4b expref: 20 pid: 14333 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.879049:0:14328:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab2b47f3400/0x96bbe788361eab52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361eab4b expref: 20 pid: 14333 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.879066:0:14328:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab2bfa7ea00/0x96bbe788361eac78 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.879074:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2bfa7ea00/0x96bbe788361eac78 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788666347.879096:0:14328:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009893486s 00010000:00010000:3.0:1788666347.879101:0:14328:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab2bfa7ea00/0x96bbe788361eac78 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.879108:0:14328:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab2bfa7ea00/0x96bbe788361eac78 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.879114:0:14328:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab2bfa7ea00/0x96bbe788361eac78 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.879119:0:14328:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab2bfa7ea00/0x96bbe788361eac78 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.879124:0:14328:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2bfa7ea00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666347.879129:0:14328:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab2bfa7ea00/0x96bbe788361eac78 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.879137:0:14328:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab2bfa7ea00/0x96bbe788361eac78 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.879146:0:14328:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab2bfa7ea00/0x96bbe788361eac78 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666347.879158:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666347.879188:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+20:3278:x1875552186241920:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666347.879194:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788666347.879234:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3278:1875552186241920:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788666347.879428:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2b47f3400/0x96bbe788361eab52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361eab4b expref: 19 pid: 14333 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666347.879441:0:14357:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14357:1875552186241792:0@lo:104: 00010000:00010000:0.0:1788666347.879455:0:14357:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab2bfa7ea00/0x96bbe788361eac78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666347.879464:0:14357:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab2bfa7ea00/0x96bbe788361eac78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666347.879469:0:14357:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab2bfa7ea00/0x96bbe788361eac78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666347.879475:0:14357:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2bfa7ea00/0x96bbe788361eac78 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14357 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666347.897790:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a088b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+18:15744:x1875552186241664:12345-0@lo:253:mount.lustre.0 Request processed in 63351us (66117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666347.897809:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788666347.897985:0:15744:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b456e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d6055fb2-45b5-486f-b848-f99f52ec1d9c:15744:1875552186241664:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788666347.898026:0:15744:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788666347.898029:0:15744:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788666347.898031:0:15744:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788666347.898033:0:15744:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788666347.898034:0:15744:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788666347.898035:0:15744:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788666347.898037:0:15744:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788666347.898038:0:15744:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788666347.898040:0:15744:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788666347.898041:0:15744:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788666347.898057:0:15744:0:(tgt_mount.c:2700:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788666347.904798:0:15744:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788666347.904976:0:15744:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788666347.905224:0:15744:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788666347.905554:0:15744:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788666347.905889:0:15744:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788666347.906221:0:15744:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788666347.912203:0:15744:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:2.0:1788666347.914965:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1abbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186242048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788666347.915039:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788666347.915490:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666347.919138:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186242048 00000100:00100000:2.0:1788666347.919158:0:15027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186242048 00000100:00100000:2.0:1788666347.919225:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788666347.919236:0:15027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186242048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788666347.919782:0:15027:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666347.919879:0:15027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1ab8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186242048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 644us (4838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666347.919888:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788666347.919955:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1abbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186242048:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1788666348.030460:0:15744:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788666348.030482:0:15744:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788666348.030525:0:15744:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788666348.030639:0:15744:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.125@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788666348.030655:0:15744:0:(tgt_mount.c:2466:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788666348.030692:0:15744:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788666348.938781:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788666349.332467:0:14373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788666349.514985:0:14339:0:(mgc_request.c:609:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788666349.514994:0:14339:0:(mgc_request.c:1800:mgc_process_log()) Process log lustre-mdtir-ffff8ab2c1c25000 from 8 10000000:01000000:0.0:1788666349.515000:0:14339:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788666349.515053:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2bfa7ea00/0x96bbe788361eac7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666349.515088:0:14339:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab2bfa7ea00/0x96bbe788361eac7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666349.515100:0:14339:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab2bfa7ea00/0x96bbe788361eac7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666349.515129:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186242176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788666349.515386:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666349.515454:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab285457d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788666349.515688:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186242176 00000100:00100000:3.0:1788666349.515696:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186242176 00000100:00100000:3.0:1788666349.515800:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788666349.515810:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a088ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+18:14339:x1875552186242176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666349.515824:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666349.515839:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2b47e8c00/0x96bbe788361eac86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361eac7f expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666349.515873:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2b47e8c00/0x96bbe788361eac86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361eac7f expref: 19 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666349.515884:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2b47e8c00/0x96bbe788361eac86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eac7f expref: 19 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666349.515905:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e8c00, rc 0) 00000100:00100000:3.0:1788666349.515957:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a088ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:14339:x1875552186242176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666349.515964:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788666349.516042:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186242176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788666349.516057:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab2bfa7ea00/0x96bbe788361eac7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eac86 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666349.516077:0:14339:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab2bfa7ea00/0x96bbe788361eac7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361eac86 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666349.516128:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186242304:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788666349.516162:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666349.522378:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab285457d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788666349.530278:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186242304 00000100:00100000:2.0:1788666349.530298:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186242304 00000100:00100000:2.0:1788666349.530368:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788666349.530379:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a0888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:14339:x1875552186242304:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788666349.530407:0:14335:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788666349.530433:0:14335:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788666349.530436:0:14335:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788666349.530571:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a0888050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:14339:x1875552186242304:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 193us (14407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666349.530595:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788666349.530834:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186242304:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788666349.530908:0:14339:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788666349.530918:0:14339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab2bfa7ea00/0x96bbe788361eac7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eac86 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666349.530928:0:14339:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab2bfa7ea00/0x96bbe788361eac7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eac86 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666349.965487:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666350.988017:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666352.013054:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788666353.035216:0:467:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788666353.035225:0:467:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788666353.035230:0:467:0:(import.c:65:import_set_state_nolock()) ffff8ab2bf987000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788666353.035255:0:467:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8ab2bf987000 using connection 192.168.201.125@tcp/0@lo 00000100:00100000:2.0:1788666353.035284:0:467:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8ab2c1ab9500 x1875552186242816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788666353.035344:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186242432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788666353.035427:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666353.035494:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3276:1875552186243072:0@lo:400:kworker.0 00000100:00100000:2.0:1788666353.035525:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666353.035555:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788666353.035560:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186242944:0@lo:400:kworker.0 00000100:00100000:2.0:1788666353.035602:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666353.035636:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186242688:0@lo:400:kworker.0 00000100:00100000:2.0:1788666353.035676:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666353.035697:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788666353.035702:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1abbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3278:1875552186242560:0@lo:400:kworker.0 00000100:00100000:2.0:1788666353.035747:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666353.035770:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3278:1875552186243200:0@lo:400:kworker.0 00000100:00100000:2.0:1788666353.035792:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666353.035819:0:3274:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186242816:0@lo:8:kworker.0 00000100:00100000:2.0:1788666353.035842:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666353.035879:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186242432 00000100:00100000:2.0:1788666353.035887:0:15027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186242432 00000100:00100000:2.0:1788666353.035942:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788666353.035951:0:15027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186242432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788666353.036002:0:15027:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666353.036050:0:15027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae725180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186242432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666353.036065:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788666353.036091:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186243072 00000100:00100000:2.0:1788666353.036095:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186243072 00000100:00100000:2.0:1788666353.036120:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186242944 00000100:00100000:2.0:1788666353.036122:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186242944 00000100:00100000:2.0:1788666353.036132:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186243200 00000100:00100000:2.0:1788666353.036135:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186243200 00000100:00100000:2.0:1788666353.036148:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788666353.036154:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875552186243072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666353.036188:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae727800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875552186243072:12345-0@lo:400:kworker.0 Request processed in 33us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666353.036194:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788666353.036204:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788666353.036209:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186242944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666353.036232:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae724a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186242944:12345-0@lo:400:kworker.0 Request processed in 23us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666353.036238:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788666353.036249:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788666353.036255:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875552186243200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666353.036285:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae727100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875552186243200:12345-0@lo:400:kworker.0 Request processed in 30us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666353.036290:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788666353.036313:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186242688 00000100:00100000:2.0:1788666353.036317:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186242688 00000100:00100000:2.0:1788666353.036337:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186242816 00000100:00100000:2.0:1788666353.036341:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186242816 00000100:00100000:2.0:1788666353.036349:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788666353.036362:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186242688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666353.036394:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae724000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186242688:12345-0@lo:400:kworker.0 Request processed in 33us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666353.036399:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788666353.036409:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788666353.036413:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3274:x1875552186242816:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788666353.036443:0:15024:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:2.0:1788666353.036481:0:15024:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x96bbe788361eac8d 00002000:00100000:2.0:1788666353.036499:0:15024:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8ab2bfbf4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788666353.036504:0:15024:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788666353.036507:0:15024:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788666353.036921:0:15024:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788666353.036948:0:15024:0:(import.c:65:import_set_state_nolock()) ffff8ab2bfbf6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788666353.037000:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae724700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3274:x1875552186242816:12345-0@lo:8:kworker.0 Request processed in 584us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666353.037007:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788666353.037030:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186242560 00000100:00100000:2.0:1788666353.037035:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186242560 00000100:00100000:2.0:1788666353.037062:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788666353.037068:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a088b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:3278:x1875552186242560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666353.037100:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a088b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:3278:x1875552186242560:12345-0@lo:400:kworker.0 Request processed in 32us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666353.037105:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1788666353.037136:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788666353.037139:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788666353.037295:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1788666353.037311:0:3274:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2c1ab9500 x1875552186242816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788666378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666353.037329:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1abbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3278:1875552186242560:0@lo:400:kworker.0 00000100:00080000:3.0:1788666353.037330:0:3274:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788666353.037338:0:3274:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00010000:00080000:2.0:1788666353.037341:0:3278:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2c1ab9c00 x1875552186243200/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788666353.037343:0:3274:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788666353.037346:0:3274:0:(import.c:65:import_set_state_nolock()) ffff8ab2bf987000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788666353.037349:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3278:1875552186243200:0@lo:400:kworker.0 00000100:00100000:2.0:1788666353.037359:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186242688:0@lo:400:kworker.0 00000004:00080000:3.0:1788666353.037362:0:3274:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788666353.037367:0:3274:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3274:1875552186242816:0@lo:8:kworker.0 00000004:00080000:2.0:1788666353.037421:0:14366:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788666353.037440:0:14366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae724e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14366:1875552186243456:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788666353.037467:0:14366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666353.037488:0:14366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab181ab2900 going to sleep for 11 seconds 00010000:00080000:2.0:1788666353.037511:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2c1abad80 x1875552186242944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666353.037521:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186242944:0@lo:400:kworker.0 00000100:00100000:2.0:1788666353.037536:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186242432:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788666353.037546:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2c1ab8380 x1875552186243072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666369 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666353.037553:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3276:1875552186243072:0@lo:400:kworker.0 00000100:00100000:2.0:1788666353.037573:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186243456 00000100:00100000:2.0:1788666353.037576:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186243456 00000100:00100000:2.0:1788666353.037625:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788666353.037632:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14366:x1875552186243456:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788666353.039283:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788666353.039317:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186243328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788666353.039401:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666353.039480:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186243328 00000100:00100000:1.0:1788666353.039489:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186243328 00000100:00100000:1.0:1788666353.039541:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788666353.039550:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae97b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3277:x1875552186243328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788666353.039615:0:15028:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666353.039685:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae97b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3277:x1875552186243328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666353.039693:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788666353.039748:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2ae725500 x1875552186243328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788666369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666353.039768:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186243328:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788666353.039819:0:14365:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788666353.040406:0:14365:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 459748824916ns, next at 0ns, rc = 0 00000100:00080000:3.0:1788666353.041739:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1788666353.047529:0:15024:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788666353.047544:0:15024:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1788666353.047549:0:15024:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:2.0:1788666353.073128:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.073142:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df119d0/0x96bbe788361eac94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.073159:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.073164:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.073171:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df119d0/0x96bbe788361eac94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.073189:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004df119d0/0x96bbe788361eac94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.073200:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df119d0/0x96bbe788361eac94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.073208:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004df119d0/0x96bbe788361eac94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.073227:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.073239:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.073245:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004df119d0/0x96bbe788361eac94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.073253:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7d000 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.073258:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004df119d0/0x96bbe788361eac94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.073279:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004df119d0/0x96bbe788361eac94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.073297:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004df119d0/0x96bbe788361eac94 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.073304:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df119d0/0x96bbe788361eac94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.073320:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.073322:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.073324:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.073820:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.073827:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37e6d1c/0x96bbe788361eac9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.073835:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.073839:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.073843:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d37e6d1c/0x96bbe788361eac9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.073853:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d37e6d1c/0x96bbe788361eac9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.073861:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37e6d1c/0x96bbe788361eac9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.073875:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d37e6d1c/0x96bbe788361eac9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.073887:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.073896:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.073900:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d37e6d1c/0x96bbe788361eac9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.073907:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7da00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.073912:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37e6d1c/0x96bbe788361eac9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.073920:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37e6d1c/0x96bbe788361eac9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.073931:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d37e6d1c/0x96bbe788361eac9b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.073937:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d37e6d1c/0x96bbe788361eac9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.073951:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.073952:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.073954:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.074342:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.074355:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffae23de/0x96bbe788361eaca2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.074364:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.074367:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.074372:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ffae23de/0x96bbe788361eaca2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.074381:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ffae23de/0x96bbe788361eaca2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.074389:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ffae23de/0x96bbe788361eaca2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.074396:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ffae23de/0x96bbe788361eaca2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.074411:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.074420:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.074424:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ffae23de/0x96bbe788361eaca2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.074431:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7ce00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.074435:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffae23de/0x96bbe788361eaca2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.074442:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ffae23de/0x96bbe788361eaca2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.074461:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ffae23de/0x96bbe788361eaca2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.074468:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ffae23de/0x96bbe788361eaca2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.074480:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.074482:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.074483:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.074900:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.074908:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032d57547/0x96bbe788361eaca9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.074916:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.074920:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.074924:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032d57547/0x96bbe788361eaca9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.074933:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032d57547/0x96bbe788361eaca9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.074940:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032d57547/0x96bbe788361eaca9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.074947:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032d57547/0x96bbe788361eaca9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.074971:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.074980:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.074984:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032d57547/0x96bbe788361eaca9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.074990:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7c200 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.074994:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032d57547/0x96bbe788361eaca9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.075002:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032d57547/0x96bbe788361eaca9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.075013:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032d57547/0x96bbe788361eaca9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.075021:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032d57547/0x96bbe788361eaca9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.075033:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.075034:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.075036:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.075408:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.075414:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062ab2fa0/0x96bbe788361eacb0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.075422:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.075432:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.075436:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062ab2fa0/0x96bbe788361eacb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.075446:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062ab2fa0/0x96bbe788361eacb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.075456:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062ab2fa0/0x96bbe788361eacb0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.075462:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062ab2fa0/0x96bbe788361eacb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.075476:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.075486:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.075489:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062ab2fa0/0x96bbe788361eacb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.075495:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7d200 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.075498:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062ab2fa0/0x96bbe788361eacb0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.075505:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062ab2fa0/0x96bbe788361eacb0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.075514:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062ab2fa0/0x96bbe788361eacb0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.075531:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062ab2fa0/0x96bbe788361eacb0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.075544:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.075546:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.075547:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.078394:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.078405:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002625a32f/0x96bbe788361eacb7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.078423:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.078427:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.078433:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002625a32f/0x96bbe788361eacb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.083110:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002625a32f/0x96bbe788361eacb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.083138:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002625a32f/0x96bbe788361eacb7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.083146:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002625a32f/0x96bbe788361eacb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.083189:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.083204:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.083217:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002625a32f/0x96bbe788361eacb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.083225:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7c000 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.083230:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002625a32f/0x96bbe788361eacb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.083239:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002625a32f/0x96bbe788361eacb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.083257:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002625a32f/0x96bbe788361eacb7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.083265:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002625a32f/0x96bbe788361eacb7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.083284:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.083286:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.083288:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.083995:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.084003:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df119d0/0x96bbe788361eacbe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.084015:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.084021:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.084027:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004df119d0/0x96bbe788361eacbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.084051:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004df119d0/0x96bbe788361eacbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.084060:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004df119d0/0x96bbe788361eacbe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.084068:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004df119d0/0x96bbe788361eacbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.084082:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.084090:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.084094:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004df119d0/0x96bbe788361eacbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.084102:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7d000 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.084106:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004df119d0/0x96bbe788361eacbe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.084114:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004df119d0/0x96bbe788361eacbe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.084124:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004df119d0/0x96bbe788361eacbe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.084133:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004df119d0/0x96bbe788361eacbe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.084153:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.084154:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.084156:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.084726:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.084734:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f62d64ea/0x96bbe788361eacc5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.084744:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.084748:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.084752:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f62d64ea/0x96bbe788361eacc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.084761:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f62d64ea/0x96bbe788361eacc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.084768:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f62d64ea/0x96bbe788361eacc5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.084775:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f62d64ea/0x96bbe788361eacc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.084789:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.084797:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.084801:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f62d64ea/0x96bbe788361eacc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.084820:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7ca00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.084824:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f62d64ea/0x96bbe788361eacc5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.084832:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f62d64ea/0x96bbe788361eacc5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.084843:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f62d64ea/0x96bbe788361eacc5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.084851:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f62d64ea/0x96bbe788361eacc5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.084866:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.084868:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.084869:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.085293:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.085301:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078670ac5/0x96bbe788361eaccc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.085309:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.085312:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.085317:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078670ac5/0x96bbe788361eaccc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.085326:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078670ac5/0x96bbe788361eaccc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.085339:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078670ac5/0x96bbe788361eaccc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.085346:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078670ac5/0x96bbe788361eaccc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.085358:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.085371:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.085375:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078670ac5/0x96bbe788361eaccc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.085381:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7c400 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.085384:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078670ac5/0x96bbe788361eaccc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.085391:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078670ac5/0x96bbe788361eaccc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.085401:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078670ac5/0x96bbe788361eaccc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.085409:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078670ac5/0x96bbe788361eaccc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.085422:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.085428:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.085429:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.086003:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.086011:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c047e7da/0x96bbe788361eacd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.086020:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.086024:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.086029:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c047e7da/0x96bbe788361eacd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.086039:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c047e7da/0x96bbe788361eacd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.086047:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c047e7da/0x96bbe788361eacd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.086054:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c047e7da/0x96bbe788361eacd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.086069:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.086078:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.086083:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c047e7da/0x96bbe788361eacd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.086090:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd5a00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.086093:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c047e7da/0x96bbe788361eacd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.086111:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c047e7da/0x96bbe788361eacd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.086122:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c047e7da/0x96bbe788361eacd3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.086129:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c047e7da/0x96bbe788361eacd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.086145:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.086146:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.086148:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.088854:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.088872:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076a7d2e5/0x96bbe788361eacda lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.088891:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.088896:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.088903:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076a7d2e5/0x96bbe788361eacda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.088919:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076a7d2e5/0x96bbe788361eacda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.088930:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076a7d2e5/0x96bbe788361eacda lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.088947:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076a7d2e5/0x96bbe788361eacda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.088966:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.088979:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.088985:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076a7d2e5/0x96bbe788361eacda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.088994:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd5c00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.088999:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076a7d2e5/0x96bbe788361eacda lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.089008:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076a7d2e5/0x96bbe788361eacda lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.089024:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076a7d2e5/0x96bbe788361eacda lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.089031:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076a7d2e5/0x96bbe788361eacda lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.089049:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.089051:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.089053:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.089956:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.089973:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdb87df0/0x96bbe788361eace1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.089985:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.089988:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.089993:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb87df0/0x96bbe788361eace1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.090004:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdb87df0/0x96bbe788361eace1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.090012:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdb87df0/0x96bbe788361eace1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.090019:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdb87df0/0x96bbe788361eace1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.090035:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.090045:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.090051:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdb87df0/0x96bbe788361eace1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.090058:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4400 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.090062:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdb87df0/0x96bbe788361eace1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.090069:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdb87df0/0x96bbe788361eace1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.090088:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdb87df0/0x96bbe788361eace1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.090095:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdb87df0/0x96bbe788361eace1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.090110:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.090112:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.090114:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.090807:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.090815:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef6aadb8/0x96bbe788361eace8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.090826:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.090829:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.090833:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6aadb8/0x96bbe788361eace8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.090842:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef6aadb8/0x96bbe788361eace8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.090851:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef6aadb8/0x96bbe788361eace8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.090859:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef6aadb8/0x96bbe788361eace8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.090883:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.090894:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.090898:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef6aadb8/0x96bbe788361eace8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.090905:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd5400 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.090908:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef6aadb8/0x96bbe788361eace8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.090917:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef6aadb8/0x96bbe788361eace8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.090928:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef6aadb8/0x96bbe788361eace8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.090936:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef6aadb8/0x96bbe788361eace8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.090955:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.090957:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.090958:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.091378:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.091384:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003af76f07/0x96bbe788361eacef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.091392:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.091401:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.091405:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003af76f07/0x96bbe788361eacef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.091414:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003af76f07/0x96bbe788361eacef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.091422:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003af76f07/0x96bbe788361eacef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.091428:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003af76f07/0x96bbe788361eacef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.091440:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.091745:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.091751:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003af76f07/0x96bbe788361eacef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.091759:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd5000 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.091763:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003af76f07/0x96bbe788361eacef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.091772:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003af76f07/0x96bbe788361eacef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.091784:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003af76f07/0x96bbe788361eacef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.091801:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003af76f07/0x96bbe788361eacef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.091816:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.091818:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.091819:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.092237:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.092244:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035bcef99/0x96bbe788361eacf6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.092253:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.092258:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.092262:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035bcef99/0x96bbe788361eacf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.092272:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035bcef99/0x96bbe788361eacf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.092281:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035bcef99/0x96bbe788361eacf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.092290:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035bcef99/0x96bbe788361eacf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.092305:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.092314:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.092323:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035bcef99/0x96bbe788361eacf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.092330:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4800 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.092334:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035bcef99/0x96bbe788361eacf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.092343:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035bcef99/0x96bbe788361eacf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.092355:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035bcef99/0x96bbe788361eacf6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.092363:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035bcef99/0x96bbe788361eacf6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.092377:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.092379:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.092381:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.093691:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.093703:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f1b89b1/0x96bbe788361eacfd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.093719:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.093723:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.093729:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f1b89b1/0x96bbe788361eacfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.093753:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f1b89b1/0x96bbe788361eacfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.093763:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f1b89b1/0x96bbe788361eacfd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.093772:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f1b89b1/0x96bbe788361eacfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.093791:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.093806:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.093812:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f1b89b1/0x96bbe788361eacfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.093819:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4000 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.093823:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f1b89b1/0x96bbe788361eacfd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.093832:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f1b89b1/0x96bbe788361eacfd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.093846:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f1b89b1/0x96bbe788361eacfd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.093853:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f1b89b1/0x96bbe788361eacfd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.093874:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.093876:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.093878:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.094284:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.094291:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014787e29/0x96bbe788361ead04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.094301:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.094304:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.094309:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014787e29/0x96bbe788361ead04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.094319:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014787e29/0x96bbe788361ead04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.094328:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014787e29/0x96bbe788361ead04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.094336:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014787e29/0x96bbe788361ead04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.094352:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.094362:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.094366:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014787e29/0x96bbe788361ead04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.094384:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4200 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.094387:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014787e29/0x96bbe788361ead04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.094395:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014787e29/0x96bbe788361ead04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.094406:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014787e29/0x96bbe788361ead04 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.094414:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014787e29/0x96bbe788361ead04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.094428:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.094430:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.094432:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.095070:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.095079:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045c0e2a5/0x96bbe788361ead0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.095091:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.095094:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.095098:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045c0e2a5/0x96bbe788361ead0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.095108:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045c0e2a5/0x96bbe788361ead0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.095123:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045c0e2a5/0x96bbe788361ead0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.095130:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045c0e2a5/0x96bbe788361ead0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.096621:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.096638:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.096644:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045c0e2a5/0x96bbe788361ead0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.096663:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4600 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.096668:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045c0e2a5/0x96bbe788361ead0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.096678:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045c0e2a5/0x96bbe788361ead0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.096698:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045c0e2a5/0x96bbe788361ead0b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.096706:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045c0e2a5/0x96bbe788361ead0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.096727:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.096736:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.096738:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.097289:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.097298:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d09a4a5/0x96bbe788361ead12 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.097310:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.097316:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.097322:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d09a4a5/0x96bbe788361ead12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.097335:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d09a4a5/0x96bbe788361ead12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.097345:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d09a4a5/0x96bbe788361ead12 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.097354:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d09a4a5/0x96bbe788361ead12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.097370:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.097380:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.097384:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d09a4a5/0x96bbe788361ead12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.097391:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4e00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.097395:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d09a4a5/0x96bbe788361ead12 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.097414:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d09a4a5/0x96bbe788361ead12 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.097427:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d09a4a5/0x96bbe788361ead12 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.097435:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d09a4a5/0x96bbe788361ead12 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.098622:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.098627:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.098629:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.099214:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.099225:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b19e7a2f/0x96bbe788361ead19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.099241:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.099246:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.099253:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b19e7a2f/0x96bbe788361ead19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.099266:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b19e7a2f/0x96bbe788361ead19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.099277:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b19e7a2f/0x96bbe788361ead19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.099296:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b19e7a2f/0x96bbe788361ead19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.099312:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.099323:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.099328:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b19e7a2f/0x96bbe788361ead19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.099336:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd5200 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.099342:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b19e7a2f/0x96bbe788361ead19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.099351:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b19e7a2f/0x96bbe788361ead19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.099366:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b19e7a2f/0x96bbe788361ead19 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.099374:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b19e7a2f/0x96bbe788361ead19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.099390:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.099392:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.099394:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.101287:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.101310:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061189bda/0x96bbe788361ead20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.101326:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.101331:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.101337:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061189bda/0x96bbe788361ead20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.101351:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061189bda/0x96bbe788361ead20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.101361:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061189bda/0x96bbe788361ead20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.101370:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061189bda/0x96bbe788361ead20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.101395:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666353.101530:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666353.101538:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061189bda/0x96bbe788361ead20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666353.101787:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4c00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666353.101794:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061189bda/0x96bbe788361ead20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666353.101804:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061189bda/0x96bbe788361ead20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666353.101825:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061189bda/0x96bbe788361ead20 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666353.101840:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061189bda/0x96bbe788361ead20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666353.101860:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666353.101862:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666353.101865:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.101898:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.101904:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb863b3b/0x96bbe788361ead27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.101912:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.101915:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.101920:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb863b3b/0x96bbe788361ead27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.101929:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb863b3b/0x96bbe788361ead27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.101945:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb863b3b/0x96bbe788361ead27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.101951:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb863b3b/0x96bbe788361ead27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.101971:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788666353.102340:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.102346:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f2ff889/0x96bbe788361ead2e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.102355:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.102358:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.102362:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f2ff889/0x96bbe788361ead2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.102371:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f2ff889/0x96bbe788361ead2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.102379:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005f2ff889/0x96bbe788361ead2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.102386:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005f2ff889/0x96bbe788361ead2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.102411:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788666353.102421:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788666353.102426:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb863b3b/0x96bbe788361ead27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.102433:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd5e00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.102436:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb863b3b/0x96bbe788361ead27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666353.102668:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666353.103668:0:15960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666353.103679:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005f2ff889/0x96bbe788361ead2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666353.103691:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4a00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666353.103695:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005f2ff889/0x96bbe788361ead2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666353.103985:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005f2ff889/0x96bbe788361ead2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666353.104519:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005f2ff889/0x96bbe788361ead2e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666353.104530:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f2ff889/0x96bbe788361ead2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.104615:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb863b3b/0x96bbe788361ead27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666353.104629:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666353.104632:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.104633:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb863b3b/0x96bbe788361ead27 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.104639:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb863b3b/0x96bbe788361ead27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666353.104644:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.104664:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.104666:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.104668:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.105226:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.105234:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014787e29/0x96bbe788361ead35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.105246:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.105255:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.105262:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014787e29/0x96bbe788361ead35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.105275:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014787e29/0x96bbe788361ead35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.105285:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014787e29/0x96bbe788361ead35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.105294:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014787e29/0x96bbe788361ead35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.105311:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666353.106335:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666353.106346:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014787e29/0x96bbe788361ead35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666353.106358:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4200 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666353.106362:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014787e29/0x96bbe788361ead35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666353.106385:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014787e29/0x96bbe788361ead35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666353.106401:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014787e29/0x96bbe788361ead35 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666353.106409:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014787e29/0x96bbe788361ead35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666353.106428:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666353.106429:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666353.106431:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.108693:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.108707:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b19e7a2f/0x96bbe788361ead3c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.108723:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.108730:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.108735:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b19e7a2f/0x96bbe788361ead3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.108748:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b19e7a2f/0x96bbe788361ead3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.108757:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b19e7a2f/0x96bbe788361ead3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.108773:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b19e7a2f/0x96bbe788361ead3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.108792:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.108808:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.108816:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b19e7a2f/0x96bbe788361ead3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.108825:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd5200 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.108830:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b19e7a2f/0x96bbe788361ead3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.108838:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b19e7a2f/0x96bbe788361ead3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.108856:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b19e7a2f/0x96bbe788361ead3c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.108864:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b19e7a2f/0x96bbe788361ead3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.108881:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.108883:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.108885:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.109369:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.109384:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d09a4a5/0x96bbe788361ead43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.109393:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.109397:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.109401:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d09a4a5/0x96bbe788361ead43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.109411:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d09a4a5/0x96bbe788361ead43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.109419:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d09a4a5/0x96bbe788361ead43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.109427:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d09a4a5/0x96bbe788361ead43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.109443:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788666353.109482:0:14329:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666353.109488:0:14329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d09a4a5/0x96bbe788361ead43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666353.109496:0:14329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4e00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666353.109500:0:14329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d09a4a5/0x96bbe788361ead43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666353.109518:0:14329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d09a4a5/0x96bbe788361ead43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666353.109529:0:14329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d09a4a5/0x96bbe788361ead43 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666353.109537:0:14329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d09a4a5/0x96bbe788361ead43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788666353.109905:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.109912:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045c0e2a5/0x96bbe788361ead4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.109921:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.109924:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.109927:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045c0e2a5/0x96bbe788361ead4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.109936:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045c0e2a5/0x96bbe788361ead4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.109950:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045c0e2a5/0x96bbe788361ead4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.109957:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045c0e2a5/0x96bbe788361ead4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.109972:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.109980:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.109984:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045c0e2a5/0x96bbe788361ead4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.109991:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4600 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.109994:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045c0e2a5/0x96bbe788361ead4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.110002:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045c0e2a5/0x96bbe788361ead4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.110013:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045c0e2a5/0x96bbe788361ead4a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.110020:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045c0e2a5/0x96bbe788361ead4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.110035:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.110042:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.110044:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666353.110128:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666353.110131:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666353.110133:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666353.110238:0:15960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666353.110241:0:15960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788666353.110446:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788666353.110452:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f1b89b1/0x96bbe788361ead51 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.110462:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788666353.110465:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666353.110470:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f1b89b1/0x96bbe788361ead51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.110479:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f1b89b1/0x96bbe788361ead51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.110488:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f1b89b1/0x96bbe788361ead51 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.110496:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f1b89b1/0x96bbe788361ead51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.110508:0:15024:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788666353.110515:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666353.110518:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f1b89b1/0x96bbe788361ead51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.110524:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4000 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666353.110528:0:14330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f1b89b1/0x96bbe788361ead51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.110545:0:14330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f1b89b1/0x96bbe788361ead51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.110556:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f1b89b1/0x96bbe788361ead51 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.110563:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f1b89b1/0x96bbe788361ead51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666353.110576:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.110596:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666353.110598:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788666353.110794:0:15024:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1788666353.110901:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae726300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14366:x1875552186243456:12345-0@lo:5:osp-pre-1-0.0 Request processed in 73265us (73429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666353.110911:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788666353.110972:0:14366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae724e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14366:1875552186243456:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788666353.110988:0:14366:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788666353.111036:0:14366:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae724e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14366:1875552186243584:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788666353.111068:0:14366:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666353.111102:0:14366:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a0baab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788666353.111116:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186243584 00000100:00100000:2.0:1788666353.111122:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186243584 00000100:00100000:2.0:1788666353.111160:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788666353.111169:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14366:x1875552186243584:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788666353.111212:0:15023:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1788666353.122723:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae725f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14366:x1875552186243584:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11546us (11645us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788666353.122737:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788666353.122793:0:14366:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae724e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14366:1875552186243584:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788666353.122808:0:14366:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:2.0:1788666353.133623:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:3.0:1788666354.058880:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666355.084210:0:15960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788666356.029912:0:16100:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg125-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788666356.106822:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666357.131051:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666358.154784:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186243712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788666358.154891:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666358.154978:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186243712 00000100:00100000:0.0:1788666358.154986:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186243712 00000100:00100000:0.0:1788666358.155047:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788666358.155056:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186243712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788666358.155091:0:15028:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666358.155139:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186243712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666358.155146:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788666358.155194:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186243712:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788666358.156168:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788666358.156181:0:15960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666358.169913:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3277:1875552186243968:0@lo:400:kworker.0 00000100:00100000:1.0:1788666358.170009:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666358.170051:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3277:1875552186244480:0@lo:400:kworker.0 00000100:00100000:1.0:1788666358.170080:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666358.170115:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788666358.170121:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186244096:0@lo:400:kworker.0 00000100:00100000:1.0:1788666358.170144:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666358.170176:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186243968 00000100:00100000:1.0:1788666358.170186:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186243968 00000100:00100000:1.0:1788666358.170237:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788666358.170246:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a0888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:3277:x1875552186243968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666358.170295:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a0888c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:3277:x1875552186243968:12345-0@lo:400:kworker.0 Request processed in 50us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666358.170304:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788666358.170364:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3277:1875552186243968:0@lo:400:kworker.0 00000100:00100000:0.0:1788666358.173134:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186243840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788666358.173667:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666358.174385:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3276:1875552186244352:0@lo:400:kworker.0 00000100:00100000:0.0:1788666358.174466:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186243840 00000100:00100000:0.0:1788666358.174475:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186243840 00000100:00100000:0.0:1788666358.174554:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788666358.174564:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3276:x1875552186243840:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788666358.175629:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788666358.175667:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186244480 00000100:00100000:2.0:1788666358.175675:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186244480 00000100:00100000:0.0:1788666358.175720:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666358.175759:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788666358.175770:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186244224:0@lo:400:kworker.0 00000100:00100000:0.0:1788666358.175795:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666358.176632:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186244352 00000100:00100000:2.0:1788666358.176639:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186244352 00000100:00100000:2.0:1788666358.176662:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186244224 00000100:00100000:2.0:1788666358.176665:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186244224 00000100:00100000:2.0:1788666358.176679:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788666358.176688:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875552186244480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666358.176766:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae97ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3277:x1875552186244480:12345-0@lo:400:kworker.0 Request processed in 79us (6684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666358.176774:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788666358.176794:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788666358.176800:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875552186244352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666358.176837:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3276:x1875552186244352:12345-0@lo:400:kworker.0 Request processed in 38us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666358.176844:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788666358.176854:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788666358.176860:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186244224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666358.177479:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186244096 00000100:00100000:3.0:1788666358.177487:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186244096 00000100:00100000:3.0:1788666358.177685:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788666358.177884:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3277:x1875552186244096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666358.177945:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae97b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3277:x1875552186244096:12345-0@lo:400:kworker.0 Request processed in 252us (7799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666358.177952:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788666358.182012:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3276:x1875552186244224:12345-0@lo:400:kworker.0 Request processed in 5147us (6211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666358.182023:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788666358.182097:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186244096:0@lo:400:kworker.0 00010000:00080000:2.0:1788666358.182114:0:3277:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2ae979180 x1875552186244480/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788666358.182126:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3277:1875552186244480:0@lo:400:kworker.0 00000100:00080000:2.0:1788666358.182153:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00000024:1.0:1788666358.182805:0:15028:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666358.182865:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3276:x1875552186243840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8299us (9196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666358.185056:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788666358.185315:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2ae97b100 x1875552186244224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666358.185331:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3276:1875552186244224:0@lo:400:kworker.0 00000100:00100000:1.0:1788666358.185354:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186243840:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788666358.185365:0:3276:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8ab2ae979880 x1875552186244352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788666374 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788666358.185374:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3276:1875552186244352:0@lo:400:kworker.0 00000001:00080000:3.0:1788666358.295269:0:7606:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:3.0:1788666358.295327:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788666358.752994:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666358.753340:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173663872 00000100:00100000:2.0:1788666358.753655:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173663872 00000100:00100000:3.0:1788666358.755840:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 75 00000100:00100000:3.0:1788666358.755854:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a0889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2357:x1875552173663872:12345-192.168.201.25@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788666358.755893:0:14333:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 6a1c8cdf-dd2d-44f3-9222-01b90bbce586@192.168.201.25@tcp t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:3.0:1788666358.755926:0:14333:0:(genops.c:1385:class_connect()) connect: client 6a1c8cdf-dd2d-44f3-9222-01b90bbce586, cookie 0x96bbe788361ead58 00000100:00080000:3.0:1788666358.756327:0:14333:0:(import.c:65:import_set_state_nolock()) ffff8ab2b482a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788666358.756481:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a0889450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+5:2357:x1875552173663872:12345-192.168.201.25@tcp:250:mount.lustre.0 Request processed in 626us (3498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666358.756491:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 75 00000100:00100000:0.0:1788666358.768345:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666358.768614:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173664000 00000100:00100000:3.0:1788666358.768627:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173664000 00000100:00100000:3.0:1788666358.768984:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 76 00000100:00100000:3.0:1788666358.768998:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a0888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+5:13771:x1875552173664000:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788666358.769015:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666358.769300:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2b47e9000/0x96bbe788361ead5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42c73 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666358.769338:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2b47e9000/0x96bbe788361ead5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c73 expref: 6 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666358.769425:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2b47e9000/0x96bbe788361ead5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c73 expref: 6 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666358.769437:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e9000, rc 0) 00000100:00100000:3.0:1788666358.769650:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a0888450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+6:13771:x1875552173664000:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 655us (1616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666358.769673:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 76 00000100:00100000:2.0:1788666358.781107:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666358.784124:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173664128 00000100:00100000:3.0:1788666358.784145:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173664128 00000100:00100000:3.0:1788666358.784245:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 77 00000100:00100000:3.0:1788666358.784257:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+6:13771:x1875552173664128:12345-192.168.201.25@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788666358.785438:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+6:13771:x1875552173664128:12345-192.168.201.25@tcp:501:mount.lustre.0 Request processed in 1176us (4337us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788666358.788201:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 77 00000100:00100000:0.0:1788666358.790907:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666358.790986:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173664256 00000100:00100000:3.0:1788666358.790998:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173664256 00000100:00100000:3.0:1788666358.791085:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 78 00000100:00100000:3.0:1788666358.791096:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+6:13771:x1875552173664256:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788666358.791113:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666358.791129:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2b47e9c00/0x96bbe788361ead66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42c7a expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666358.791156:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2b47e9c00/0x96bbe788361ead66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c7a expref: 7 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666358.791168:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2b47e9c00/0x96bbe788361ead66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42c7a expref: 7 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666358.791178:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e9c00, rc 0) 00000100:00100000:3.0:1788666358.791259:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+7:13771:x1875552173664256:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 164us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666358.791267:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 78 00000100:00100000:0.0:1788666358.796189:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666358.797168:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173664384 00000100:00100000:2.0:1788666358.797181:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173664384 00000100:00100000:2.0:1788666358.797283:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:2.0:1788666358.797293:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+7:13771:x1875552173664384:12345-192.168.201.25@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788666358.797640:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+8:13771:x1875552173664384:12345-192.168.201.25@tcp:501:mount.lustre.0 Request processed in 348us (1464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666358.797649:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 79 00000100:00100000:3.0:1788666358.799754:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666358.800223:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173664512 00000100:00100000:1.0:1788666358.800234:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173664512 00000100:00100000:1.0:1788666358.800278:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 80 00000100:00100000:1.0:1788666358.800288:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+8:13771:x1875552173664512:12345-192.168.201.25@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788666358.801171:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+8:13771:x1875552173664512:12345-192.168.201.25@tcp:503:mount.lustre.0 Request processed in 879us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666358.801183:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 80 00000100:00100000:0.0:1788666358.805089:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666358.805183:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173664640 00000100:00100000:2.0:1788666358.805194:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173664640 00000100:00100000:2.0:1788666358.805249:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 81 00000100:00100000:2.0:1788666358.805259:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+8:13790:x1875552173664640:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788666358.805858:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+8:13790:x1875552173664640:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 598us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666358.805868:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 81 00000100:00100000:3.0:1788666358.820927:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666358.821089:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173664768 00000100:00100000:0.0:1788666358.821101:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173664768 00000100:00100000:0.0:1788666358.821165:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 82 00000100:00100000:0.0:1788666358.821174:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+8:13790:x1875552173664768:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788666358.821497:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+8:13790:x1875552173664768:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 322us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666358.821505:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 82 00000100:00100000:3.0:1788666358.833427:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666358.833777:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173664896 00000100:00100000:2.0:1788666358.833789:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173664896 00000100:00100000:2.0:1788666358.833854:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 83 00000100:00100000:2.0:1788666358.833865:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+8:13771:x1875552173664896:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788666358.833883:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666358.833913:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab283fd5a00/0x96bbe788361ead6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42ca4 expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666358.833943:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab283fd5a00/0x96bbe788361ead6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ca4 expref: 9 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666358.833957:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab283fd5a00/0x96bbe788361ead6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ca4 expref: 9 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666358.833967:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd5a00, rc 0) 00000100:00100000:2.0:1788666358.834167:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+9:13771:x1875552173664896:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 303us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666358.834174:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 83 00000100:00100000:3.0:1788666358.841496:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666358.841672:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173665024 00000100:00100000:1.0:1788666358.841684:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173665024 00000100:00100000:1.0:1788666358.841741:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 84 00000100:00100000:1.0:1788666358.841752:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+9:13771:x1875552173665024:12345-192.168.201.25@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788666358.841782:0:14334:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788666358.841812:0:14334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788666358.841816:0:14334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788666358.841819:0:14334:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788666358.841822:0:14334:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788666358.856665:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+9:13771:x1875552173665024:12345-192.168.201.25@tcp:256:mount.lustre.0 Request processed in 14902us (15169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666358.856682:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 84 00000100:00100000:3.0:1788666358.860258:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666358.860465:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173665152 00000100:00100000:2.0:1788666358.860478:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173665152 00000100:00100000:2.0:1788666358.860543:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 85 00000100:00100000:2.0:1788666358.860553:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+9:13771:x1875552173665152:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788666358.860632:0:14333:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666358.860652:0:14333:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361ead74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42cab expref: -99 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666358.860686:0:14333:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361ead74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42cab expref: 10 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666358.860719:0:14333:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361ead74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42cab expref: 10 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666358.860729:0:14333:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd5c00, rc 0) 00000100:00100000:2.0:1788666358.860795:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8beec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+10:13771:x1875552173665152:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 244us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666358.860802:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 85 00000100:00100000:3.0:1788666358.862762:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666358.863031:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173665280 00000100:00100000:1.0:1788666358.863044:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173665280 00000100:00100000:1.0:1788666358.863098:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 86 00000100:00100000:1.0:1788666358.863107:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+10:13771:x1875552173665280:12345-192.168.201.25@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788666358.863522:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+10:13771:x1875552173665280:12345-192.168.201.25@tcp:501:mount.lustre.0 Request processed in 414us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666358.863531:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 86 00000100:00100000:0.0:1788666358.866486:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666358.866715:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173665408 00000100:00100000:3.0:1788666358.866726:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173665408 00000100:00100000:3.0:1788666358.866785:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 87 00000100:00100000:3.0:1788666358.866796:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+10:13771:x1875552173665408:12345-192.168.201.25@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788666358.867197:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8becc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+10:13771:x1875552173665408:12345-192.168.201.25@tcp:503:mount.lustre.0 Request processed in 401us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666358.867205:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 87 00000100:00100000:2.0:1788666358.870978:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666358.871136:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173665536 00000100:00100000:1.0:1788666358.871148:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173665536 00000100:00100000:1.0:1788666358.871204:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 88 00000100:00100000:1.0:1788666358.871214:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+10:13795:x1875552173665536:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788666358.871621:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+10:13795:x1875552173665536:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 364us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666358.871631:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 88 00000100:00100000:0.0:1788666358.883374:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666358.883479:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173665664 00000100:00100000:2.0:1788666358.883490:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173665664 00000100:00100000:2.0:1788666358.883548:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 89 00000100:00100000:2.0:1788666358.883568:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+10:13795:x1875552173665664:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788666358.883865:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+10:13795:x1875552173665664:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 308us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666358.883872:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 89 00000100:00100000:0.0:1788666358.902177:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666358.902295:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173665792 00000100:00100000:3.0:1788666358.902306:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173665792 00000100:00100000:3.0:1788666358.902358:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:3.0:1788666358.902367:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2357:x1875552173665792:12345-192.168.201.25@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788666358.902401:0:15046:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a312b542-833a-4024-a333-5685ada48983@192.168.201.25@tcp t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:3.0:1788666358.902463:0:15046:0:(genops.c:1385:class_connect()) connect: client a312b542-833a-4024-a333-5685ada48983, cookie 0x96bbe788361ead7b 00000004:00100000:3.0:1788666358.902495:0:15046:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788666358.902501:0:15046:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1788666358.950747:0:15046:0:(import.c:65:import_set_state_nolock()) ffff8ab2b482c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788666358.950847:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a312b542-833a-4024-a333-5685ada48983+6:2357:x1875552173665792:12345-192.168.201.25@tcp:38:mount.lustre.0 Request processed in 48478us (48678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666358.950860:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:3.0:1788666358.954876:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666358.955101:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666358.955965:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173665920 00000100:00100000:2.0:1788666358.955977:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173665920 00000100:00100000:2.0:1788666358.956089:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173666048 00000100:00100000:2.0:1788666358.956092:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173666048 00000100:00080000:3.0:1788666358.956128:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666358.956168:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:0.0:1788666358.956182:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a312b542-833a-4024-a333-5685ada48983+7:0:x1875552173665920:12345-192.168.201.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788666358.956238:0:14342:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788666358.956352:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a312b542-833a-4024-a333-5685ada48983+7:0:x1875552173665920:12345-192.168.201.25@tcp:41:mount.lustre.0 Request processed in 173us (1487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666358.956359:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:0.0:1788666358.956390:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:0.0:1788666358.956396:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a312b542-833a-4024-a333-5685ada48983+6:13771:x1875552173666048:12345-192.168.201.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788666358.956406:0:14342:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788666358.956424:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a312b542-833a-4024-a333-5685ada48983+6:13771:x1875552173666048:12345-192.168.201.25@tcp:41:mount.lustre.0 Request processed in 29us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666358.956444:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:3.0:1788666358.959074:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666358.959349:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173666176 00000100:00100000:1.0:1788666358.959360:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173666176 00000100:00100000:1.0:1788666358.959427:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:1.0:1788666358.959438:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a312b542-833a-4024-a333-5685ada48983+6:13771:x1875552173666176:12345-192.168.201.25@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788666358.959550:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a312b542-833a-4024-a333-5685ada48983+6:13771:x1875552173666176:12345-192.168.201.25@tcp:40:mount.lustre.0 Request processed in 114us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666358.959620:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:3.0:1788666358.962306:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666358.962353:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666358.962402:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666358.962432:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173666304 00000100:00100000:3.0:1788666358.962443:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173666304 00000100:00100000:3.0:1788666358.962487:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173666432 00000100:00100000:3.0:1788666358.962490:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173666432 00000100:00100000:3.0:1788666358.962503:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:3.0:1788666358.962511:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875552173666304:12345-192.168.201.25@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788666358.962547:0:15023:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a312b542-833a-4024-a333-5685ada48983@192.168.201.25@tcp t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:3.0:1788666358.962626:0:15023:0:(genops.c:1385:class_connect()) connect: client a312b542-833a-4024-a333-5685ada48983, cookie 0x96bbe788361ead82 00002000:00100000:3.0:1788666358.962639:0:15023:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a312b542-833a-4024-a333-5685ada48983/ffff8ab2b4829000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788666358.962652:0:15023:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788666358.963077:0:15023:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788666358.963108:0:15023:0:(import.c:65:import_set_state_nolock()) ffff8ab298ba0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788666358.963175:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a312b542-833a-4024-a333-5685ada48983+6:2357:x1875552173666304:12345-192.168.201.25@tcp:8:mount.lustre.0 Request processed in 662us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666358.963183:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:3.0:1788666358.963205:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:3.0:1788666358.963210:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2357:x1875552173666432:12345-192.168.201.25@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788666358.963227:0:15023:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a312b542-833a-4024-a333-5685ada48983@192.168.201.25@tcp t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:3.0:1788666358.963247:0:15023:0:(genops.c:1385:class_connect()) connect: client a312b542-833a-4024-a333-5685ada48983, cookie 0x96bbe788361ead89 00002000:00100000:3.0:1788666358.963253:0:15023:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a312b542-833a-4024-a333-5685ada48983/ffff8ab2901df800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788666358.963266:0:15023:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788666358.963465:0:15023:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788666358.963489:0:15023:0:(import.c:65:import_set_state_nolock()) ffff8ab2bc1cd800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788666358.963513:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a312b542-833a-4024-a333-5685ada48983+6:2357:x1875552173666432:12345-192.168.201.25@tcp:8:mount.lustre.0 Request processed in 300us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666358.963520:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:1.0:1788666358.964956:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173666560 00000100:00100000:1.0:1788666358.964969:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173666560 00000100:00100000:1.0:1788666358.965025:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:1.0:1788666358.965035:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a312b542-833a-4024-a333-5685ada48983+6:13771:x1875552173666560:12345-192.168.201.25@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788666358.966304:0:14344:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1203us 00000004:00200000:1.0:1788666358.982048:0:14344:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788666358.982215:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a312b542-833a-4024-a333-5685ada48983+6:13771:x1875552173666560:12345-192.168.201.25@tcp:33:mount.lustre.0 Request processed in 17174us (19911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666358.982227:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00010000:00010000:2.0:1788666359.179766:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666359.187288:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666359.189381:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173666688 00000100:00100000:1.0:1788666359.189401:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173666688 00000100:00100000:1.0:1788666359.189647:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:1.0:1788666359.189661:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+6:13816:x1875552173666688:12345-192.168.201.25@tcp:101:mkdir.0 00010000:00010000:1.0:1788666359.189687:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666359.189735:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854800/0x96bbe788361ead90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42cd5 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666359.189812:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ead97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666359.189823:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ead97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666359.189833:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ead97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788666359.189883:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788666359.189886:0:14341:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788666359.189922:0:14341:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ead97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666359.189951:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298854800/0x96bbe788361ead90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42cd5 expref: 8 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666359.189972:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ead97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42cd5 expref: 7 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666359.189978:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:1.0:1788666359.189981:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788666359.189984:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855a00, rc 0) 00000100:00100000:1.0:1788666359.190062:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+7:13816:x1875552173666688:12345-192.168.201.25@tcp:101:mkdir.0 Request processed in 405us (2786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666359.190067:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00000040:00080000:3.0:1788666359.564895:0:14373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788666360.202856:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666361.227605:0:15960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666361.618982:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666361.619514:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173666816 00000100:00100000:2.0:1788666361.619528:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173666816 00000100:00080000:3.0:1788666361.619607:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666361.619653:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:2.0:1788666361.619666:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a312b542-833a-4024-a333-5685ada48983+7:13868:x1875552173666816:12345-192.168.201.25@tcp:41:lfs.0 00000004:00000024:2.0:1788666361.619715:0:15046:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788666361.619816:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a312b542-833a-4024-a333-5685ada48983+7:13868:x1875552173666816:12345-192.168.201.25@tcp:41:lfs.0 Request processed in 152us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666361.619849:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:3.0:1788666361.631897:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666361.631991:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173666944 00000100:00100000:0.0:1788666361.632003:0:15027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173666944 00000100:00080000:3.0:1788666361.632090:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788666361.632096:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:0.0:1788666361.632108:0:15027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a312b542-833a-4024-a333-5685ada48983+6:13868:x1875552173666944:12345-192.168.201.25@tcp:13:lfs.0 00002000:00000024:0.0:1788666361.632150:0:15027:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666361.632258:0:15027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a312b542-833a-4024-a333-5685ada48983+6:13868:x1875552173666944:12345-192.168.201.25@tcp:13:lfs.0 Request processed in 151us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666361.632266:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:3.0:1788666361.635013:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666361.635125:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173667072 00000100:00100000:1.0:1788666361.635138:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173667072 00000100:00100000:1.0:1788666361.635228:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:1.0:1788666361.635236:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a312b542-833a-4024-a333-5685ada48983+6:13868:x1875552173667072:12345-192.168.201.25@tcp:13:lfs.0 00002000:00000024:1.0:1788666361.635280:0:15028:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788666361.635389:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a312b542-833a-4024-a333-5685ada48983+6:13868:x1875552173667072:12345-192.168.201.25@tcp:13:lfs.0 Request processed in 154us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666361.635394:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00080000:3.0:1788666361.635785:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788666361.886154:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666361.886301:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173667200 00000100:00100000:0.0:1788666361.886314:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173667200 00000100:00100000:0.0:1788666361.886378:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 90 00000100:00100000:0.0:1788666361.886389:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2a8bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+10:13900:x1875552173667200:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788666361.886416:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666361.886435:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2bfa7fc00/0x96bbe788361ead9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42cdc expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666361.886464:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2bfa7fc00/0x96bbe788361ead9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42cdc expref: 11 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666361.886475:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2bfa7fc00/0x96bbe788361ead9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42cdc expref: 11 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666361.886485:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2bfa7fc00, rc 0) 00000100:00100000:0.0:1788666361.886563:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2a8bee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+11:13900:x1875552173667200:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 176us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666361.886612:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 90 00000100:00100000:2.0:1788666361.902332:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666361.902500:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173667328 00000100:00100000:1.0:1788666361.902537:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173667328 00000100:00100000:1.0:1788666361.902631:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 91 00000100:00100000:1.0:1788666361.902642:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bcd57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+11:13900:x1875552173667328:12345-192.168.201.25@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788666361.903537:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bcd57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+11:13900:x1875552173667328:12345-192.168.201.25@tcp:501:mount.lustre.0 Request processed in 891us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666361.903547:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 91 00000100:00100000:3.0:1788666361.915986:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666361.916147:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173667456 00000100:00100000:2.0:1788666361.916157:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173667456 00000100:00100000:2.0:1788666361.916219:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 92 00000100:00100000:2.0:1788666361.916229:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bcd54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+11:13900:x1875552173667456:12345-192.168.201.25@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788666361.916489:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bcd54050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+11:13900:x1875552173667456:12345-192.168.201.25@tcp:503:mount.lustre.0 Request processed in 260us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666361.916498:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 92 00000100:00100000:3.0:1788666361.925373:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666361.925575:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173667584 00000100:00100000:1.0:1788666361.925612:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173667584 00000100:00100000:1.0:1788666361.925677:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 93 00000100:00100000:1.0:1788666361.925688:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bcd57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+11:13908:x1875552173667584:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788666361.926500:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bcd57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+11:13908:x1875552173667584:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 811us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666361.926520:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 93 00000100:00100000:3.0:1788666361.944826:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666361.944978:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173667712 00000100:00100000:0.0:1788666361.944989:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173667712 00000100:00100000:0.0:1788666361.945048:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 94 00000100:00100000:0.0:1788666361.945059:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bcd56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+11:13908:x1875552173667712:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788666361.945320:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bcd56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+11:13908:x1875552173667712:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 262us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666361.945328:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 94 00000100:00100000:3.0:1788666361.950987:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666361.951350:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173667840 00000100:00100000:1.0:1788666361.951361:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173667840 00000100:00100000:1.0:1788666361.951428:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 95 00000100:00100000:1.0:1788666361.951438:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bcd55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+11:13900:x1875552173667840:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788666361.951456:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666361.951476:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab298855400/0x96bbe788361eada5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42d06 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666361.951516:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab298855400/0x96bbe788361eada5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d06 expref: 12 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666361.951529:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab298855400/0x96bbe788361eada5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d06 expref: 12 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666361.951569:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298855400, rc 0) 00000100:00100000:1.0:1788666361.951801:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bcd55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+12:13900:x1875552173667840:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 364us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666361.951809:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 95 00000100:00100000:3.0:1788666361.959179:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666361.959277:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173667968 00000100:00100000:2.0:1788666361.959287:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173667968 00000100:00100000:2.0:1788666361.959345:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 96 00000100:00100000:2.0:1788666361.959355:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bcd54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+12:13900:x1875552173667968:12345-192.168.201.25@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788666361.959386:0:14333:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788666361.959424:0:14333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788666361.959429:0:14333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788666361.959433:0:14333:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788666361.959435:0:14333:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788666361.964261:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bcd54850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+12:13900:x1875552173667968:12345-192.168.201.25@tcp:256:mount.lustre.0 Request processed in 4896us (5079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666361.964276:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 96 00000100:00100000:3.0:1788666361.967626:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666361.968134:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173668096 00000100:00100000:0.0:1788666361.968145:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173668096 00000100:00100000:0.0:1788666361.968343:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 97 00000100:00100000:0.0:1788666361.968355:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bcd55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+12:13900:x1875552173668096:12345-192.168.201.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788666361.968373:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666361.968411:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2bfa7e000/0x96bbe788361eadac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42d0d expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666361.968444:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2bfa7e000/0x96bbe788361eadac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d0d expref: 13 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666361.968456:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2bfa7e000/0x96bbe788361eadac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d0d expref: 13 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666361.968466:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2bfa7e000, rc 0) 00000100:00100000:0.0:1788666361.968543:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bcd55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+13:13900:x1875552173668096:12345-192.168.201.25@tcp:101:mount.lustre.0 Request processed in 189us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666361.968550:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 97 00000100:00100000:3.0:1788666361.971559:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666361.971768:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173668224 00000100:00100000:2.0:1788666361.971778:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173668224 00000100:00100000:2.0:1788666361.971845:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 98 00000100:00100000:2.0:1788666361.971862:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+13:13900:x1875552173668224:12345-192.168.201.25@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788666361.972154:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa49850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+13:13900:x1875552173668224:12345-192.168.201.25@tcp:501:mount.lustre.0 Request processed in 300us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666361.972161:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 98 00000100:00100000:3.0:1788666361.976639:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666361.976729:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173668352 00000100:00100000:0.0:1788666361.976740:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173668352 00000100:00100000:0.0:1788666361.976796:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 99 00000100:00100000:0.0:1788666361.976814:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+13:13900:x1875552173668352:12345-192.168.201.25@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788666361.977042:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa4a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+13:13900:x1875552173668352:12345-192.168.201.25@tcp:503:mount.lustre.0 Request processed in 229us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666361.977050:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 99 00000100:00100000:3.0:1788666361.991741:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666361.991967:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173668480 00000100:00100000:1.0:1788666361.991977:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173668480 00000100:00100000:1.0:1788666361.992070:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 100 00000100:00100000:1.0:1788666361.992080:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+13:13913:x1875552173668480:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788666361.992334:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa48450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+13:13913:x1875552173668480:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 254us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666361.992342:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 100 00000100:00100000:3.0:1788666362.004685:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666362.009456:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173668608 00000100:00100000:2.0:1788666362.009474:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173668608 00000100:00100000:2.0:1788666362.009567:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 101 00000100:00100000:2.0:1788666362.009577:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+13:13913:x1875552173668608:12345-192.168.201.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788666362.010189:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa4a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+13:13913:x1875552173668608:12345-192.168.201.25@tcp:502:llog_process_th.0 Request processed in 318us (5218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666362.010207:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 101 00000100:00100000:3.0:1788666362.022699:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666362.022742:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666362.022785:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666362.022835:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666362.022876:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173669376 00000100:00100000:3.0:1788666362.022886:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173669376 00000100:00100000:1.0:1788666362.022912:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173668736 00000100:00100000:1.0:1788666362.022917:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173668736 00000100:00100000:1.0:1788666362.022957:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173669120 00000100:00100000:1.0:1788666362.022960:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173669120 00000100:00100000:1.0:1788666362.022995:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:1.0:1788666362.023005:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+7:2361:x1875552173669120:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666362.023083:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+7:2361:x1875552173669120:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 79us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666362.023091:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:1.0:1788666362.023109:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:1.0:1788666362.023114:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2357:x1875552173668736:12345-192.168.201.25@tcp:38:mount.lustre.0 00000100:00100000:0.0:1788666362.023116:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173669248 00000100:00100000:0.0:1788666362.023119:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173669248 00010000:00080000:1.0:1788666362.023137:0:14341:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6d4f8905-33ad-4a53-acca-61c229032b2c@192.168.201.25@tcp t0 exp 0000000000000000 cur 468 last 0 00000100:00100000:0.0:1788666362.023148:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:0.0:1788666362.023154:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a312b542-833a-4024-a333-5685ada48983+6:2361:x1875552173669248:12345-192.168.201.25@tcp:400:kworker.0 00000020:00000080:1.0:1788666362.023171:0:14341:0:(genops.c:1385:class_connect()) connect: client 6d4f8905-33ad-4a53-acca-61c229032b2c, cookie 0x96bbe788361eadb3 00000100:00100000:0.0:1788666362.023183:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a312b542-833a-4024-a333-5685ada48983+6:2361:x1875552173669248:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 29us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666362.023188:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 3 00000004:00100000:1.0:1788666362.023211:0:14341:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788666362.023336:0:14341:0:(import.c:65:import_set_state_nolock()) ffff8ab182f05800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788666362.023384:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d4f8905-33ad-4a53-acca-61c229032b2c+6:2357:x1875552173668736:12345-192.168.201.25@tcp:38:mount.lustre.0 Request processed in 269us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666362.023391:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:3.0:1788666362.023516:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:3.0:1788666362.023525:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a312b542-833a-4024-a333-5685ada48983+6:2361:x1875552173669376:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666362.023552:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a312b542-833a-4024-a333-5685ada48983+6:2361:x1875552173669376:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 30us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666362.023558:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:3.0:1788666362.030498:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666362.036454:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666362.049445:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173668864 00000100:00100000:0.0:1788666362.049464:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173668864 00000100:00100000:2.0:1788666362.049587:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173668992 00000100:00100000:2.0:1788666362.049592:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173668992 00000100:00080000:3.0:1788666362.049655:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788666362.049742:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:1.0:1788666362.049754:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d4f8905-33ad-4a53-acca-61c229032b2c+7:0:x1875552173668864:12345-192.168.201.25@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788666362.049789:0:15046:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788666362.049882:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d4f8905-33ad-4a53-acca-61c229032b2c+7:0:x1875552173668864:12345-192.168.201.25@tcp:41:mount.lustre.0 Request processed in 130us (19398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666362.049888:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:1.0:1788666362.049906:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:1.0:1788666362.049913:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d4f8905-33ad-4a53-acca-61c229032b2c+6:13900:x1875552173668992:12345-192.168.201.25@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788666362.049924:0:15046:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788666362.049947:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d4f8905-33ad-4a53-acca-61c229032b2c+6:13900:x1875552173668992:12345-192.168.201.25@tcp:41:mount.lustre.0 Request processed in 35us (13503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666362.049953:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:3.0:1788666362.052267:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666362.057243:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173669504 00000100:00100000:0.0:1788666362.057262:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173669504 00000100:00100000:0.0:1788666362.057324:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:0.0:1788666362.057335:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d4f8905-33ad-4a53-acca-61c229032b2c+6:13900:x1875552173669504:12345-192.168.201.25@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788666362.057553:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d4f8905-33ad-4a53-acca-61c229032b2c+6:13900:x1875552173669504:12345-192.168.201.25@tcp:40:mount.lustre.0 Request processed in 219us (5294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666362.057561:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:3.0:1788666362.060046:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666362.060087:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666362.060128:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666362.060212:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173669632 00000100:00100000:0.0:1788666362.060221:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173669632 00000100:00100000:0.0:1788666362.060259:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173669760 00000100:00100000:0.0:1788666362.060263:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173669760 00000100:00100000:0.0:1788666362.060295:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:0.0:1788666362.060303:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875552173669632:12345-192.168.201.25@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788666362.060336:0:15024:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6d4f8905-33ad-4a53-acca-61c229032b2c@192.168.201.25@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:0.0:1788666362.060367:0:15024:0:(genops.c:1385:class_connect()) connect: client 6d4f8905-33ad-4a53-acca-61c229032b2c, cookie 0x96bbe788361eadba 00002000:00100000:0.0:1788666362.060391:0:15024:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6d4f8905-33ad-4a53-acca-61c229032b2c/ffff8ab2c1f28800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788666362.060659:0:15024:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788666362.060778:0:15024:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788666362.060818:0:15024:0:(import.c:65:import_set_state_nolock()) ffff8ab2c1f29000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788666362.060879:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d4f8905-33ad-4a53-acca-61c229032b2c+6:2357:x1875552173669632:12345-192.168.201.25@tcp:8:mount.lustre.0 Request processed in 575us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666362.060887:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:0.0:1788666362.060908:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:0.0:1788666362.060914:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2357:x1875552173669760:12345-192.168.201.25@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788666362.060931:0:15024:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6d4f8905-33ad-4a53-acca-61c229032b2c@192.168.201.25@tcp t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:0.0:1788666362.060952:0:15024:0:(genops.c:1385:class_connect()) connect: client 6d4f8905-33ad-4a53-acca-61c229032b2c, cookie 0x96bbe788361eadc1 00002000:00100000:0.0:1788666362.060958:0:15024:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6d4f8905-33ad-4a53-acca-61c229032b2c/ffff8ab2b4220800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788666362.060964:0:15024:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788666362.061022:0:15024:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788666362.061037:0:15024:0:(import.c:65:import_set_state_nolock()) ffff8ab2bbf66800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788666362.061061:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa74700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d4f8905-33ad-4a53-acca-61c229032b2c+6:2357:x1875552173669760:12345-192.168.201.25@tcp:8:mount.lustre.0 Request processed in 147us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666362.061068:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:1.0:1788666362.062318:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173669888 00000100:00100000:1.0:1788666362.062331:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173669888 00000100:00100000:1.0:1788666362.062494:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:1.0:1788666362.062516:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d4f8905-33ad-4a53-acca-61c229032b2c+6:13900:x1875552173669888:12345-192.168.201.25@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788666362.062651:0:14345:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788666362.062773:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d4f8905-33ad-4a53-acca-61c229032b2c+6:13900:x1875552173669888:12345-192.168.201.25@tcp:33:mount.lustre.0 Request processed in 270us (2735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666362.062780:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 1 00010000:00010000:2.0:1788666362.250904:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666362.365283:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666362.365398:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173670016 00000100:00100000:0.0:1788666362.365409:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173670016 00000100:00100000:0.0:1788666362.365506:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:0.0:1788666362.365517:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d4f8905-33ad-4a53-acca-61c229032b2c+6:13934:x1875552173670016:12345-192.168.201.25@tcp:101:mkdir.0 00010000:00010000:0.0:1788666362.365540:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666362.365563:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eadc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42d37 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666362.365663:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eadcf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666362.365679:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eadcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666362.365695:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eadcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666362.365733:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788666362.365738:0:14341:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788666362.365774:0:14341:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eadcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666362.365801:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eadc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d37 expref: 8 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666362.365820:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eadcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d37 expref: 7 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666362.365829:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:0.0:1788666362.365832:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788666362.365836:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2bfa7f600, rc 0) 00000100:00100000:0.0:1788666362.366071:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d4f8905-33ad-4a53-acca-61c229032b2c+7:13934:x1875552173670016:12345-192.168.201.25@tcp:101:mkdir.0 Request processed in 555us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666362.366086:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:0.0:1788666363.278771:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186244608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788666363.278858:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666363.278946:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186244608 00000100:00100000:0.0:1788666363.278955:0:15027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186244608 00000100:00100000:0.0:1788666363.279020:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788666363.279028:0:15027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186244608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788666363.279050:0:15027:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666363.279092:0:15027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186244608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666363.279099:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1788666363.279122:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788666363.279156:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186244608:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788666363.279858:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666363.289210:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186244736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788666363.289296:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666363.289357:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3275:1875552186245248:0@lo:400:kworker.0 00000100:00100000:1.0:1788666363.289404:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666363.289429:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788666363.289435:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3275:1875552186244864:0@lo:400:kworker.0 00000100:00100000:1.0:1788666363.289462:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666363.289493:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186245376:0@lo:400:kworker.0 00000100:00100000:1.0:1788666363.289516:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666363.289549:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186245248 00000100:00100000:1.0:1788666363.289558:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186245248 00000100:00100000:1.0:1788666363.289626:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186245376 00000100:00100000:1.0:1788666363.289630:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186245376 00000100:00100000:1.0:1788666363.289653:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788666363.289662:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1875552186245248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666363.289718:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3275:x1875552186245248:12345-0@lo:400:kworker.0 Request processed in 57us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666363.289741:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788666363.289761:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788666363.289767:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186245376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666363.289792:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186245376:12345-0@lo:400:kworker.0 Request processed in 26us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666363.289798:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788666363.289814:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186244864 00000100:00100000:1.0:1788666363.289817:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186244864 00000100:00100000:0.0:1788666363.289974:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae97bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875552186245120:0@lo:400:kworker.0 00000100:00100000:0.0:1788666363.290005:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666363.290028:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788666363.290034:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186244992:0@lo:400:kworker.0 00000100:00100000:0.0:1788666363.290055:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666363.290084:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186244736 00000100:00100000:0.0:1788666363.290087:0:15027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186244736 00000100:00100000:0.0:1788666363.290119:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788666363.290125:0:15027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186244736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788666363.290143:0:15027:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666363.290177:0:15027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186244736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666363.290198:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788666363.290218:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788666363.290223:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666363.290232:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186245120 00000100:00100000:0.0:1788666363.290235:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186245120 00000100:00100000:0.0:1788666363.290252:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788666363.290257:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875552186245120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666363.290293:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875552186245120:12345-0@lo:400:kworker.0 Request processed in 35us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666363.290299:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788666363.290319:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186244992 00000100:00100000:0.0:1788666363.290322:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186244992 00000100:00100000:0.0:1788666363.290341:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788666363.290347:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186244992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666363.290373:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186244992:12345-0@lo:400:kworker.0 Request processed in 26us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666363.290379:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788666363.290412:0:3278:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788666363.290435:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186244992:0@lo:400:kworker.0 00000100:00100000:0.0:1788666363.290448:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875552186245120:0@lo:400:kworker.0 00000100:00100000:1.0:1788666363.293648:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788666363.293675:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:3275:x1875552186244864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788666363.293814:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa49c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:3275:x1875552186244864:12345-0@lo:400:kworker.0 Request processed in 154us (4351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666363.293822:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788666363.294020:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae97b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3275:1875552186244864:0@lo:400:kworker.0 00000100:00100000:1.0:1788666363.294044:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae978e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186245376:0@lo:400:kworker.0 00000100:00100000:1.0:1788666363.294069:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae979880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186244736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788666363.294082:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3275:1875552186245248:0@lo:400:kworker.0 00000001:00100000:3.0:1788666363.336176:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6d4f8905-33ad-4a53-acca-61c229032b2c 00000001:00100000:3.0:1788666363.336267:0:7606:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a312b542-833a-4024-a333-5685ada48983 00000001:00100000:0.0:1788666363.360619:0:6678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6d4f8905-33ad-4a53-acca-61c229032b2c 00000001:00100000:0.0:1788666363.360639:0:6678:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a312b542-833a-4024-a333-5685ada48983 00010000:00010000:0.0:1788666364.304109:0:15960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788666364.361615:0:5830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6d4f8905-33ad-4a53-acca-61c229032b2c 00000001:00100000:1.0:1788666364.361634:0:5830:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a312b542-833a-4024-a333-5685ada48983 00010000:00010000:2.0:1788666365.328270:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788666365.986446:0:16307:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788666366.346961:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788666367.371346:0:15960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666367.499921:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666367.499966:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666367.500190:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666367.500228:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173670400 00000100:00100000:3.0:1788666367.500240:0:15026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173670400 00000100:00100000:3.0:1788666367.500308:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:3.0:1788666367.500320:0:15026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a312b542-833a-4024-a333-5685ada48983+5:2362:x1875552173670400:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666367.500460:0:15026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a312b542-833a-4024-a333-5685ada48983+5:2362:x1875552173670400:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 141us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666367.500468:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00080000:3.0:1788666367.500491:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788666367.501113:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173670144 00000100:00100000:0.0:1788666367.501121:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173670144 00000100:00100000:0.0:1788666367.501168:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 103 00000100:00100000:0.0:1788666367.501175:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+13:2362:x1875552173670144:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666367.501211:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa49050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+13:2362:x1875552173670144:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 36us (1302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666367.501217:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 103 00000100:00100000:3.0:1788666367.503291:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666367.503332:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666367.503368:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173670528 00000100:00100000:0.0:1788666367.503376:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173670528 00000100:00100000:0.0:1788666367.503436:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:0.0:1788666367.503445:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a312b542-833a-4024-a333-5685ada48983+5:2361:x1875552173670528:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:0.0:1788666367.503505:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a312b542-833a-4024-a333-5685ada48983+5:2361:x1875552173670528:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 62us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666367.503512:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:3.0:1788666367.513472:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666367.513507:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666367.513542:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173670784 00000100:00100000:3.0:1788666367.513553:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173670784 00000100:00100000:3.0:1788666367.513614:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173670912 00000100:00100000:3.0:1788666367.513617:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173670912 00000100:00100000:3.0:1788666367.513636:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:3.0:1788666367.513645:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d4f8905-33ad-4a53-acca-61c229032b2c+5:2361:x1875552173670784:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666367.513716:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa76680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d4f8905-33ad-4a53-acca-61c229032b2c+5:2361:x1875552173670784:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 72us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666367.513724:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:3.0:1788666367.513739:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:3.0:1788666367.513744:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d4f8905-33ad-4a53-acca-61c229032b2c+5:2361:x1875552173670912:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666367.513773:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6d4f8905-33ad-4a53-acca-61c229032b2c+5:2361:x1875552173670912:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 29us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666367.513779:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00080000:3.0:1788666367.513799:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788666367.513803:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788666367.517236:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173670272 00000100:00100000:2.0:1788666367.517252:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173670272 00000100:00100000:3.0:1788666367.517464:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173670656 00000100:00100000:3.0:1788666367.517470:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173670656 00000100:00100000:3.0:1788666367.517520:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:3.0:1788666367.517531:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a312b542-833a-4024-a333-5685ada48983+6:2361:x1875552173670272:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666367.517639:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a312b542-833a-4024-a333-5685ada48983+6:2361:x1875552173670272:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 110us (17672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666367.517647:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:3.0:1788666367.517666:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:3.0:1788666367.517673:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d4f8905-33ad-4a53-acca-61c229032b2c+6:2362:x1875552173670656:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666367.517700:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d4f8905-33ad-4a53-acca-61c229032b2c+6:2362:x1875552173670656:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 27us (14367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666367.517706:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00080000:2.0:1788666367.518276:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788666368.395747:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186245504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788666368.395833:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666368.400820:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186245504 00000100:00100000:3.0:1788666368.400837:0:15027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186245504 00000100:00100000:3.0:1788666368.400919:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788666368.400929:0:15027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186245504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788666368.401052:0:15027:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788666368.401142:0:15027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa74000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186245504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 215us (5309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666368.401150:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1788666368.401211:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666368.401251:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa75180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186245504:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788666368.402208:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788666368.404989:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186245632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788666368.405075:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666368.405208:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3275:1875552186245760:0@lo:400:kworker.0 00000100:00100000:2.0:1788666368.405239:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666368.405263:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788666368.405268:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186245888:0@lo:400:kworker.0 00000100:00100000:0.0:1788666368.405283:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186245632 00000100:00100000:0.0:1788666368.405290:0:15027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186245632 00000100:00100000:2.0:1788666368.405292:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666368.405320:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186245760 00000100:00100000:2.0:1788666368.405324:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186245760 00000100:00100000:0.0:1788666368.405344:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788666368.405353:0:15027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186245632:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788666368.405355:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788666368.405360:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:3275:x1875552186245760:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1788666368.405388:0:15027:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666368.405418:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa48050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:3275:x1875552186245760:12345-0@lo:400:kworker.0 Request processed in 57us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666368.405425:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788666368.405431:0:15027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae727b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186245632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666368.405436:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1788666368.405452:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788666368.405466:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3275:1875552186245760:0@lo:400:kworker.0 00000100:00100000:2.0:1788666368.405486:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3278:1875552186246144:0@lo:400:kworker.0 00000100:00100000:2.0:1788666368.405508:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666368.405545:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186245632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788666368.405557:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788666368.405562:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186246016:0@lo:400:kworker.0 00000100:00100000:0.0:1788666368.405570:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186245888 00000100:00100000:0.0:1788666368.405574:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186245888 00000100:00100000:2.0:1788666368.405601:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666368.405617:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186246144 00000100:00100000:0.0:1788666368.405620:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186246144 00000100:00100000:2.0:1788666368.405637:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186246016 00000100:00100000:2.0:1788666368.405640:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186246016 00000100:00100000:0.0:1788666368.405641:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788666368.405654:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186245888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666368.405657:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788666368.405662:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875552186246144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788666368.405690:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae725c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3278:x1875552186246144:12345-0@lo:400:kworker.0 Request processed in 27us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666368.405690:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3275:x1875552186245888:12345-0@lo:400:kworker.0 Request processed in 36us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666368.405697:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788666368.405704:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788666368.405708:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788666368.405714:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186246016:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788666368.405720:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666368.405736:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3275:1875552186245888:0@lo:400:kworker.0 00000100:00100000:2.0:1788666368.405737:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae726d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186246016:12345-0@lo:400:kworker.0 Request processed in 24us (135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666368.405742:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788666368.405764:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae727480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186246016:0@lo:400:kworker.0 00000100:00100000:2.0:1788666368.405782:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3278:1875552186246144:0@lo:400:kworker.0 00010000:00010000:3.0:1788666369.420769:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788666369.809237:0:14373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000080:0.0:1788666369.914882:0:16455:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe89ead450 20000000:00000080:0.0:1788666369.914907:0:16455:0:(mgs_handler.c:1166:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8ab1818d4400 uarg=0000000000000000 20000000:01000000:0.0:1788666369.914948:0:16455:0:(mgs_llog.c:6191:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788666369.914954:0:16455:0:(mgs_llog.c:4646:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788666369.914959:0:16455:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788666369.917253:0:16456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788666369.917563:0:16455:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788666369.927556:0:16455:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788666369.928667:0:16455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8ab2bfa7fa00/0x96bbe788361eadd6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666369.928694:0:16455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab2b47e8e00/0x96bbe788361eaacd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eaac6 expref: 18 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666369.928702:0:16455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab2b47f2600/0x96bbe788361eab1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eab13 expref: 18 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666369.928709:0:16455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361eac4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eac47 expref: 18 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666369.928732:0:16455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361ead74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42cab expref: 12 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666369.928738:0:16455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8ab2bfa7e000/0x96bbe788361eadac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d0d expref: 12 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666369.928937:0:16455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8ab2bfa7fa00/0x96bbe788361eadd6 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666369.928986:0:16455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab2bfa7e000/0x96bbe788361eadac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d0d expref: 12 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666369.929002:0:16455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab2bfa7e000/0x96bbe788361eadac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d0d expref: 12 pid: 14335 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666369.929020:0:16455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16455:1875552186246272:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788666369.929172:0:16455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361ead74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42cab expref: 12 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666369.929181:0:16455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361ead74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42cab expref: 12 pid: 14333 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666369.929189:0:16455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16455:1875552186246400:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788666369.929220:0:16455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361eac4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361eac47 expref: 18 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666369.929228:0:16455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361eac4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361eac47 expref: 18 pid: 14335 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666369.929237:0:16455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16455:1875552186246528:0@lo:104: 00000100:00100000:0.0:1788666369.929291:0:16455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666369.929687:0:14325:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186246528 00000100:00100000:2.0:1788666369.929696:0:14325:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186246528 00000100:00100000:2.0:1788666369.929762:0:14325:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788666369.929782:0:14325:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+3:16455:x1875552186246528:12345-0@lo:104: 00010000:00010000:2.0:1788666369.929797:0:14325:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7de00/0x96bbe788361eac47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361eac4e expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666369.934715:0:14325:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788666369.934853:0:14325:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+3:16455:x1875552186246528:12345-0@lo:104: Request processed in 5067us (5555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666369.934866:0:14325:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788666369.934914:0:15960:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788666369.934922:0:15960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7de00/0x96bbe788361eac47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361eac4e expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666369.934932:0:15960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2a1d7de00 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:2.0:1788666369.934936:0:15960:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7de00/0x96bbe788361eac47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361eac4e expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666369.934946:0:15960:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7de00/0x96bbe788361eac47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361eac4e expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788666369.934953:0:15960:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7de00/0x96bbe788361eac47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361eac4e expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788666369.934958:0:15960:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788666369.935023:0:15960:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7de00/0x96bbe788361eac47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361eac4e expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666369.935032:0:15960:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788666369.936278:0:15960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7de00/0x96bbe788361eac47 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361eac4e expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666369.936294:0:15960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab2a1d7de00/0x96bbe788361eac47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361eac4e expref: -99 pid: 15744 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666369.936486:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3275:1875552186246656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788666369.936571:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788666369.936874:0:15960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666369.936877:0:15960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788666369.936880:0:15960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666369.937825:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186246656 00000100:00100000:2.0:1788666369.937836:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186246656 00010000:00010000:2.0:1788666369.937873:0:14328:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361eac4e lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361eac47 expref: 19 pid: 14335 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666369.937903:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788666369.937911:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:3275:x1875552186246656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788666369.937926:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666369.937932:0:14328:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361eac4e lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361eac47 expref: 19 pid: 14335 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666369.937943:0:14328:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361eac4e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361eac47 expref: 19 pid: 14335 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666369.937962:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788666369.938518:0:16455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab2b47f2600/0x96bbe788361eab1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361eab13 expref: 19 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666369.938550:0:16455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab2b47f2600/0x96bbe788361eab1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361eab13 expref: 19 pid: 14335 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666369.938563:0:16455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2b480f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16455:1875552186246784:0@lo:104: 00000100:00100000:0.0:1788666369.938647:0:16455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788666369.938676:0:16455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8ab2b47e8e00/0x96bbe788361eaacd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x96bbe788361eaac6 expref: 19 pid: 14333 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666369.938685:0:16455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8ab2b47e8e00/0x96bbe788361eaacd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x96bbe788361eaac6 expref: 19 pid: 14333 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666369.938693:0:16455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae979180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16455:1875552186246912:0@lo:104: 00000100:00100000:0.0:1788666369.938724:0:16455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666369.938738:0:16455:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2aea25840 going to sleep for 11 seconds 00000100:00100000:0.0:1788666369.938761:0:16455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16455:1875552186246272:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788666369.938991:0:16455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2a1d7cc00/0x96bbe788361eac4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361eac47 expref: 19 pid: 14335 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666369.939004:0:16455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16455:1875552186246528:0@lo:104: 00000100:00100000:0.0:1788666369.939064:0:14324:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788666369.939075:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186246784 00000100:00100000:0.0:1788666369.939088:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186246784 00000100:00100000:0.0:1788666369.939121:0:14324:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186246912 00000100:00100000:0.0:1788666369.939124:0:14324:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186246912 00000100:00100000:0.0:1788666369.939137:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788666369.939144:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+4:16455:x1875552186246784:12345-0@lo:104: 00010000:00010000:0.0:1788666369.939157:0:14324:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab298855600/0x96bbe788361eab13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361eab1a expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666369.939228:0:14324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788666369.939234:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+4:16455:x1875552186246784:12345-0@lo:104: Request processed in 90us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666369.939242:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788666369.939894:0:14324:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788666369.939908:0:14324:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab29050f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+3:16455:x1875552186246912:12345-0@lo:104: 00010000:00010000:0.0:1788666369.939918:0:14324:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8600/0x96bbe788361eaac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361eaacd expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666369.939966:0:14324:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788666369.939971:0:14324:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab29050f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+3:16455:x1875552186246912:12345-0@lo:104: Request processed in 69us (1246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666369.939976:0:14324:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788666369.940042:0:16455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16455:1875552186246784:0@lo:104: 00000100:00100000:0.0:1788666369.940050:0:16455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae979180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16455:1875552186246912:0@lo:104: 00000100:00100000:3.0:1788666369.941002:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666369.941237:0:16455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2b480e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16455:1875552186246400:192.168.201.25@tcp:104: 00010000:00010000:0.0:1788666369.941282:0:16455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8ab2bfa7fa00/0x96bbe788361eadd6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666369.941509:0:14327:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788666369.941520:0:14327:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:3.0:1788666369.941943:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666369.941982:0:14326:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788666369.941995:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173671040 00000100:00100000:3.0:1788666369.942003:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173671040 00010000:00010000:3.0:1788666369.942032:0:14326:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab2bfa7e000/0x96bbe788361eadac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d0d expref: 13 pid: 14335 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666369.942640:0:14326:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788666369.942649:0:14326:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173671168 00000100:00100000:3.0:1788666369.942653:0:14326:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173671168 00010000:00010000:3.0:1788666369.942668:0:14326:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361ead74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42cab expref: 14 pid: 14333 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666369.942681:0:14326:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788666369.942688:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:3.0:1788666369.942696:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+14:2364:x1875552173671040:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666369.942711:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666369.942725:0:14326:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab2bfa7e000/0x96bbe788361eadac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d0d expref: 14 pid: 14335 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666369.942737:0:14326:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab2bfa7e000/0x96bbe788361eadac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d0d expref: 14 pid: 14335 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666369.942756:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2bfa7e000/0x96bbe788361eadac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d0d expref: 14 pid: 14335 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666369.942891:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666369.942956:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+13:2364:x1875552173671040:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 259us (1958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666369.942964:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:3.0:1788666369.942980:0:14326:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788666369.942998:0:14326:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:3.0:1788666369.943005:0:14326:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c10bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+12:2363:x1875552173671168:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666369.943014:0:14326:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666369.943018:0:14326:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361ead74 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42cab expref: 12 pid: 14333 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666369.943027:0:14326:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361ead74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42cab expref: 12 pid: 14333 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666369.943037:0:14326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361ead74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42cab expref: 12 pid: 14333 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666369.943563:0:14326:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666369.943668:0:14326:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c10bb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+11:2363:x1875552173671168:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 606us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666369.943675:0:14326:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00010000:00010000:3.0:1788666369.943694:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788666369.943701:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab298855600/0x96bbe788361eab13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361eab1a expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666369.943754:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855600 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:3.0:1788666369.943760:0:14330:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab298855600/0x96bbe788361eab13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361eab1a expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666369.943875:0:14330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab298855600/0x96bbe788361eab13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361eab1a expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788666369.943882:0:14330:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab298855600/0x96bbe788361eab13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361eab1a expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666369.943900:0:14330:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788666369.943943:0:14330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab298855600/0x96bbe788361eab13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361eab1a expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666369.943950:0:14330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788666369.943970:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab298855600/0x96bbe788361eab13 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361eab1a expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666369.943977:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab298855600/0x96bbe788361eab13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361eab1a expref: -99 pid: 15022 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666369.943987:0:14330:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788666369.943989:0:14330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8600/0x96bbe788361eaac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x96bbe788361eaacd expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666369.943995:0:14330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e8600 already unused, calling callback (ffffffffc1b63c20) 10000000:00010000:3.0:1788666369.943998:0:14330:0:(mgc_request.c:920:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8600/0x96bbe788361eaac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x96bbe788361eaacd expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666369.944005:0:14330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8600/0x96bbe788361eaac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x96bbe788361eaacd expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788666369.944012:0:14330:0:(mgc_request.c:926:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8600/0x96bbe788361eaac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x96bbe788361eaacd expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788666369.944017:0:14330:0:(mgc_request.c:930:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788666369.944029:0:14330:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8600/0x96bbe788361eaac6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361eaacd expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666369.944034:0:14330:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788666369.944189:0:14330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8600/0x96bbe788361eaac6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361eaacd expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666369.944196:0:14330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.125@tcp lock: ffff8ab2b47e8600/0x96bbe788361eaac6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x96bbe788361eaacd expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666369.944209:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666369.944211:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666369.944212:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666369.944218:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666369.944230:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3276:1875552186247040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788666369.944985:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666369.945381:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3277:1875552186247168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788666369.945473:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666369.945655:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+18:3275:x1875552186246656:12345-0@lo:103:ldlm_bl.0 Request processed in 7743us (9082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666369.945665:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788666369.945741:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186247040 00000100:00100000:2.0:1788666369.945748:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186247040 00010000:00010000:2.0:1788666369.945786:0:14328:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab2b47f2600/0x96bbe788361eab1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361eab13 expref: 18 pid: 14335 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666369.945949:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3275:1875552186246656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788666369.946005:0:16457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186247168 00000100:00100000:1.0:1788666369.946009:0:16457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186247168 00010000:00010000:1.0:1788666369.946027:0:16457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8ab2b47e8e00/0x96bbe788361eaacd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361eaac6 expref: 19 pid: 14333 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666369.946214:0:16457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788666369.946224:0:16457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae27bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:3276:x1875552186247040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788666369.946238:0:16457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666369.946244:0:16457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab2b47f2600/0x96bbe788361eab1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361eab13 expref: 19 pid: 14335 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666369.946278:0:16457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab2b47f2600/0x96bbe788361eab1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361eab13 expref: 19 pid: 14335 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666369.946295:0:16457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2b47f2600/0x96bbe788361eab1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361eab13 expref: 19 pid: 14335 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666369.946309:0:16457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666369.946357:0:16457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae27bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d6055fb2-45b5-486f-b848-f99f52ec1d9c+18:3276:x1875552186247040:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (1374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666369.946373:0:16457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788666369.946388:0:16457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788666369.946394:0:16457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae278000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d6055fb2-45b5-486f-b848-f99f52ec1d9c+17:3277:x1875552186247168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788666369.946402:0:16457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666369.946406:0:16457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8ab2b47e8e00/0x96bbe788361eaacd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x96bbe788361eaac6 expref: 17 pid: 14333 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666369.946424:0:16457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8ab2b47e8e00/0x96bbe788361eaacd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x96bbe788361eaac6 expref: 17 pid: 14333 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666369.946435:0:16457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2b47e8e00/0x96bbe788361eaacd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x96bbe788361eaac6 expref: 17 pid: 14333 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666369.946447:0:16457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8ab2bfa7fa00/0x96bbe788361eadd6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666369.946456:0:16457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2bfa7fa00/0x96bbe788361eadd6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666369.946470:0:16457:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab2bfa7fa00/0x96bbe788361eadd6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666369.946483:0:16457:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8ab2bfa7fa00/0x96bbe788361eadd6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666369.946490:0:16457:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8ab2bfa7fa00/0x96bbe788361eadd6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666369.946496:0:16457:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8ab2bfa7fa00/0x96bbe788361eadd6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666369.946502:0:16457:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2bfa7fa00 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:1.0:1788666369.946507:0:16457:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8ab2bfa7fa00/0x96bbe788361eadd6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666369.946515:0:16457:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8ab2bfa7fa00/0x96bbe788361eadd6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666369.946530:0:16457:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8ab2bfa7fa00/0x96bbe788361eadd6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666369.946541:0:16457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666369.946569:0:16457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae278000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:3277:x1875552186247168:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666369.946575:0:16457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788666369.947199:0:16455:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8ab2bfa7fa00/0x96bbe788361eadd6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666369.947208:0:16455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8ab2bfa7fa00/0x96bbe788361eadd6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666369.947214:0:16455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8ab2bfa7fa00/0x96bbe788361eadd6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666369.950684:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa74a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3276:1875552186247040:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788666369.955491:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3277:1875552186247168:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788666370.444052:0:15960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788666371.141551:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666371.141670:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173671296 00000100:00100000:1.0:1788666371.141682:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173671296 00000100:00100000:1.0:1788666371.141735:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 105 00000100:00100000:1.0:1788666371.141745:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b607b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+11:13786:x1875552173671296:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788666371.141763:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666371.141781:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab298854800/0x96bbe788361eaddd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42d3e expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666371.141822:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab298854800/0x96bbe788361eaddd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d3e expref: 12 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666371.141834:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab298854800/0x96bbe788361eaddd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d3e expref: 12 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666371.141853:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298854800, rc 0) 00000100:00100000:1.0:1788666371.141915:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b607b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+12:13786:x1875552173671296:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 171us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666371.141922:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 105 00000100:00100000:2.0:1788666371.151921:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666371.152100:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173671424 00000100:00100000:0.0:1788666371.152112:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173671424 00000100:00100000:0.0:1788666371.152174:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 106 00000100:00100000:0.0:1788666371.152184:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b6079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+12:13786:x1875552173671424:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788666371.152522:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b6079050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+12:13786:x1875552173671424:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 339us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666371.152531:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 106 00000100:00100000:2.0:1788666371.158175:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666371.158212:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173671552 00000100:00100000:2.0:1788666371.158222:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173671552 00000100:00100000:2.0:1788666371.158278:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 107 00000100:00100000:2.0:1788666371.158288:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b607b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+12:13786:x1875552173671552:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788666371.158664:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b607b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+12:13786:x1875552173671552:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 Request processed in 376us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666371.158673:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 107 00000100:00100000:0.0:1788666371.176625:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666371.177072:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173671680 00000100:00100000:3.0:1788666371.177085:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173671680 00000100:00100000:3.0:1788666371.177151:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 108 00000100:00100000:3.0:1788666371.177161:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b607b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+12:13786:x1875552173671680:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666371.177182:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666371.177201:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2b47e8600/0x96bbe788361eade4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42d45 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666371.177230:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2b47e8600/0x96bbe788361eade4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d45 expref: 13 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666371.177242:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2b47e8600/0x96bbe788361eade4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d45 expref: 13 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666371.177276:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e8600, rc 0) 00000100:00100000:3.0:1788666371.177357:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b607b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+13:13786:x1875552173671680:12345-192.168.201.25@tcp:101:ll_cfg_requeue.0 Request processed in 197us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666371.177364:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 108 00000100:00100000:0.0:1788666371.199983:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666371.200559:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173671808 00000100:00100000:2.0:1788666371.200569:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173671808 00000100:00100000:2.0:1788666371.200648:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 109 00000100:00100000:2.0:1788666371.200658:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b607ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+13:13786:x1875552173671808:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788666371.200970:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b607ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+13:13786:x1875552173671808:12345-192.168.201.25@tcp:501:ll_cfg_requeue.0 Request processed in 312us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666371.200979:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 109 00000100:00100000:2.0:1788666371.207062:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666371.207140:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173671936 00000100:00100000:3.0:1788666371.207151:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173671936 00000100:00100000:3.0:1788666371.207211:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 110 00000100:00100000:3.0:1788666371.207220:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b607a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+13:13786:x1875552173671936:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788666371.207464:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b607a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+13:13786:x1875552173671936:12345-192.168.201.25@tcp:503:ll_cfg_requeue.0 Request processed in 243us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666371.207472:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 110 00010000:00010000:0.0:1788666371.470618:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788666371.724114:0:14339:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1788666371.724121:0:14339:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff8ab2ae320000 from 10 10000000:01000000:1.0:1788666371.724127:0:14339:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788666371.724173:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab298854000/0x96bbe788361eadeb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666371.724184:0:14339:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab298854000/0x96bbe788361eadeb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666371.724197:0:14339:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab298854000/0x96bbe788361eadeb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666371.724303:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea1ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186247296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788666371.724387:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666371.724442:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab183862480 going to sleep for 11 seconds 00000100:00100000:3.0:1788666371.724503:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186247296 00000100:00100000:3.0:1788666371.724511:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186247296 00000100:00100000:3.0:1788666371.724577:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788666371.724621:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b6078050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+16:14339:x1875552186247296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666371.724637:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666371.724652:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab2b47e9a00/0x96bbe788361eadf2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361eadeb expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666371.724675:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab2b47e9a00/0x96bbe788361eadf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361eadeb expref: 17 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666371.724695:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab2b47e9a00/0x96bbe788361eadf2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eadeb expref: 17 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666371.724705:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e9a00, rc 0) 00000100:00100000:3.0:1788666371.724757:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b6078050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+17:14339:x1875552186247296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666371.724765:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788666371.725116:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea1ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186247296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788666371.725131:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab298854000/0x96bbe788361eadeb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eadf2 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666371.725146:0:14339:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab298854000/0x96bbe788361eadeb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361eadf2 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666371.725200:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea1ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186247424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788666371.725360:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666371.725385:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab183862480 going to sleep for 11 seconds 00000100:00100000:1.0:1788666371.725400:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186247424 00000100:00100000:1.0:1788666371.725404:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186247424 00000100:00100000:1.0:1788666371.725431:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788666371.725437:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b6078850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+17:14339:x1875552186247424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788666371.726121:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b6078850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+17:14339:x1875552186247424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 681us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666371.726130:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788666371.726175:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea1ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186247424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788666371.726209:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea1ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186247552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788666371.726762:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666371.726831:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab183862480 going to sleep for 11 seconds 00000100:00100000:3.0:1788666371.729833:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186247552 00000100:00100000:3.0:1788666371.729851:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186247552 00000100:00100000:2.0:1788666371.731513:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788666371.731526:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b6079450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+17:14339:x1875552186247552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788666371.731897:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b6079450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+17:14339:x1875552186247552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 373us (5134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666371.731906:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788666371.732378:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea1ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186247552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788666371.733062:0:16510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788666371.733124:0:14339:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788666371.733138:0:14339:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788666371.733150:0:14339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab298854000/0x96bbe788361eadeb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eadf2 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666371.733163:0:14339:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab298854000/0x96bbe788361eadeb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eadf2 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666371.733183:0:14339:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1788666371.733185:0:14339:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff8ab2b44dd800 from 10 10000000:01000000:1.0:1788666371.733188:0:14339:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788666371.733224:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab298855600/0x96bbe788361eadf9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666371.733379:0:14339:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab298855600/0x96bbe788361eadf9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666371.733389:0:14339:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab298855600/0x96bbe788361eadf9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666371.733413:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea1ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186247680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788666371.733472:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666371.733504:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab183862180 going to sleep for 11 seconds 00000100:00100000:1.0:1788666371.733522:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186247680 00000100:00100000:1.0:1788666371.733529:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186247680 00000100:00100000:1.0:1788666371.733573:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788666371.733607:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b607bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+17:14339:x1875552186247680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788666371.733620:0:14334:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788666371.733633:0:14334:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab298854400/0x96bbe788361eae00 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361eadf9 expref: -99 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666371.733654:0:14334:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab298854400/0x96bbe788361eae00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361eadf9 expref: 18 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666371.733665:0:14334:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab298854400/0x96bbe788361eae00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eadf9 expref: 18 pid: 14334 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666371.734307:0:14334:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab298854400, rc 0) 00000100:00100000:1.0:1788666371.734417:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b607bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+18:14339:x1875552186247680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 810us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666371.734426:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788666371.737829:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea1ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186247680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788666371.737861:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab298855600/0x96bbe788361eadf9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eae00 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666371.737875:0:14339:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab298855600/0x96bbe788361eadf9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361eae00 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666371.737956:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae27a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186247808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788666371.738021:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666371.738069:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab284f60d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788666371.738128:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186247808 00000100:00100000:2.0:1788666371.738135:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186247808 00000100:00100000:2.0:1788666371.738184:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788666371.738193:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b6079850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+18:14339:x1875552186247808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788666371.738800:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b6079850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+18:14339:x1875552186247808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 607us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666371.738810:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788666371.740077:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae27a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186247808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788666371.753042:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae727480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186247936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788666371.753136:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666371.753180:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2c1f35600 going to sleep for 11 seconds 00000100:00100000:1.0:1788666371.753347:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186247936 00000100:00100000:1.0:1788666371.753354:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186247936 00000100:00100000:1.0:1788666371.753403:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788666371.753412:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b6078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+18:14339:x1875552186247936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788666371.753636:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b6078450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+18:14339:x1875552186247936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 224us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666371.753643:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788666371.753719:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae727480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186247936:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788666371.754666:0:16512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788666371.756396:0:14339:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788666371.756424:0:14339:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788666371.756436:0:14339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab298855600/0x96bbe788361eadf9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eae00 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666371.756450:0:14339:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab298855600/0x96bbe788361eadf9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eae00 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788666371.756460:0:14339:0:(mgc_request.c:609:do_requeue()) updating log params 10000000:01000000:1.0:1788666371.756463:0:14339:0:(mgc_request.c:1800:mgc_process_log()) Process log params-ffff8ab2c1c25000 from 10 10000000:01000000:1.0:1788666371.756465:0:14339:0:(mgc_request.c:994:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788666371.756505:0:14339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab298854600/0x96bbe788361eae07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666371.756528:0:14339:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.125@tcp lock: ffff8ab298854600/0x96bbe788361eae07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666371.756539:0:14339:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.125@tcp lock: ffff8ab298854600/0x96bbe788361eae07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666371.756565:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186248064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788666371.756648:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666371.756760:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2a42820c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788666371.757082:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186248064 00000100:00100000:2.0:1788666371.757091:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186248064 00000100:00100000:2.0:1788666371.757137:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788666371.757146:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b607a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+18:14339:x1875552186248064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788666371.757161:0:14335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666371.757175:0:14335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361eae0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x96bbe788361eae07 expref: -99 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666371.757198:0:14335:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361eae0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x96bbe788361eae07 expref: 19 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666371.757210:0:14335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8ab283fd5c00/0x96bbe788361eae0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x96bbe788361eae07 expref: 19 pid: 14335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666371.757241:0:14335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd5c00, rc 0) 00000100:00100000:2.0:1788666371.757289:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b607a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:14339:x1875552186248064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666371.757296:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788666371.757352:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea1e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186248064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788666371.757367:0:14339:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.125@tcp lock: ffff8ab298854600/0x96bbe788361eae07 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eae0e expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666371.757377:0:14339:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.125@tcp lock: ffff8ab298854600/0x96bbe788361eae07 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x96bbe788361eae0e expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666371.757426:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae727480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186248192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788666371.757453:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666371.757467:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2c1f35e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788666371.757478:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186248192 00000100:00100000:2.0:1788666371.757481:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186248192 00000100:00100000:2.0:1788666371.757497:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788666371.757503:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b607a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:14339:x1875552186248192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788666371.757952:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b607a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:14339:x1875552186248192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 448us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666371.757960:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788666371.757991:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae727480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186248192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788666371.758018:0:14339:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae727480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186248320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788666371.758055:0:14339:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666371.758076:0:14339:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29a089900 going to sleep for 11 seconds 00000100:00100000:2.0:1788666371.758086:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186248320 00000100:00100000:2.0:1788666371.758090:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186248320 00000100:00100000:2.0:1788666371.758105:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788666371.758111:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b6079c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:14339:x1875552186248320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788666371.758472:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b6079c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:14339:x1875552186248320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 360us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666371.758479:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788666371.767858:0:14339:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae727480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d6055fb2-45b5-486f-b848-f99f52ec1d9c:14339:1875552186248320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788666371.773542:0:16514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788666371.773836:0:14339:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788666371.773858:0:14339:0:(mgc_request.c:1877:mgc_process_log()) MGC192.168.201.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788666371.773870:0:14339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.125@tcp lock: ffff8ab298854600/0x96bbe788361eae07 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eae0e expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666371.773881:0:14339:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.125@tcp lock: ffff8ab298854600/0x96bbe788361eae07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x96bbe788361eae0e expref: -99 pid: 14339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666372.491720:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788666372.620864:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666372.620903:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666372.620929:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666372.620950:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666372.620970:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666372.620989:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666372.621014:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666372.624797:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173672320 00000100:00100000:2.0:1788666372.624817:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173672320 00000100:00100000:2.0:1788666372.625164:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173672448 00000100:00100000:2.0:1788666372.625170:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173672448 00000100:00100000:2.0:1788666372.625189:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173672704 00000100:00100000:2.0:1788666372.625192:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173672704 00000100:00100000:2.0:1788666372.625206:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173672832 00000100:00100000:2.0:1788666372.625209:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173672832 00000100:00100000:2.0:1788666372.625231:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:2.0:1788666372.625242:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a312b542-833a-4024-a333-5685ada48983+5:2361:x1875552173672320:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666372.625347:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a312b542-833a-4024-a333-5685ada48983+5:2361:x1875552173672320:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 106us (4416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666372.625355:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:2.0:1788666372.625375:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:2.0:1788666372.625382:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a312b542-833a-4024-a333-5685ada48983+5:2362:x1875552173672448:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666372.625410:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a312b542-833a-4024-a333-5685ada48983+5:2362:x1875552173672448:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 28us (4458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666372.625416:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:2.0:1788666372.625427:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:2.0:1788666372.625448:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d4f8905-33ad-4a53-acca-61c229032b2c+5:2362:x1875552173672704:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666372.625475:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d4f8905-33ad-4a53-acca-61c229032b2c+5:2362:x1875552173672704:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 30us (4486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666372.625481:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:2.0:1788666372.625493:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:2.0:1788666372.625499:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae97b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d4f8905-33ad-4a53-acca-61c229032b2c+5:2361:x1875552173672832:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666372.625521:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae97b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6d4f8905-33ad-4a53-acca-61c229032b2c+5:2361:x1875552173672832:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 23us (4506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666372.625526:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:2.0:1788666372.625550:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173672064 00000100:00100000:2.0:1788666372.625554:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173672064 00000100:00100000:2.0:1788666372.625600:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 120 00000100:00100000:2.0:1788666372.625608:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c10b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+13:2361:x1875552173672064:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666372.627649:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c10b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+13:2361:x1875552173672064:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 2030us (6733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666372.627663:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 120 00000100:00100000:2.0:1788666372.627724:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173672192 00000100:00100000:2.0:1788666372.627731:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173672192 00000100:00100000:2.0:1788666372.627780:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173672576 00000100:00100000:2.0:1788666372.627783:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173672576 00000100:00100000:2.0:1788666372.627811:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:2.0:1788666372.627818:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+6:2362:x1875552173672192:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666372.627866:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+6:2362:x1875552173672192:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 49us (7014us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666372.627873:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:2.0:1788666372.627895:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00100000:2.0:1788666372.627900:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d4f8905-33ad-4a53-acca-61c229032b2c+6:2361:x1875552173672576:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666372.627924:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d4f8905-33ad-4a53-acca-61c229032b2c+6:2361:x1875552173672576:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 25us (6955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666372.627930:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00080000:0.0:1788666372.632913:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788666372.632925:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788666372.632928:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788666373.514906:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788666373.514936:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186248448:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788666373.515010:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788666373.515132:0:15960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666373.515175:0:15027:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186248448 00000100:00100000:3.0:1788666373.515191:0:15027:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186248448 00000100:00100000:3.0:1788666373.515256:0:15027:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788666373.515264:0:15027:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae97bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186248448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788666373.515337:0:15027:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788666373.515521:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788666373.515709:0:15027:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae97bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186248448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 445us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666373.515718:0:15027:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788666373.515805:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae279500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186248448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788666373.516006:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3275:1875552186248576:0@lo:400:kworker.0 00000100:00100000:2.0:1788666373.516044:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666373.516066:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186249088:0@lo:400:kworker.0 00000100:00100000:2.0:1788666373.516090:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666373.516110:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788666373.516115:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186248704:0@lo:400:kworker.0 00000100:00100000:2.0:1788666373.516138:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666373.516163:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186248960:0@lo:400:kworker.0 00000100:00100000:2.0:1788666373.516198:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666373.516216:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788666373.516221:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875552186248832:0@lo:400:kworker.0 00000100:00100000:2.0:1788666373.516241:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666373.516265:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186249088 00000100:00100000:2.0:1788666373.516270:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186249088 00000100:00100000:0.0:1788666373.516505:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186249216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788666373.516532:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666373.519395:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186248960 00000100:00100000:0.0:1788666373.519411:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186248960 00000100:00100000:0.0:1788666373.519463:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186248832 00000100:00100000:0.0:1788666373.519465:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186248832 00000100:00100000:0.0:1788666373.519483:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788666373.519492:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186249088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666373.519617:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae727480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186249088:12345-0@lo:400:kworker.0 Request processed in 127us (3526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666373.519623:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788666373.519641:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788666373.519646:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186248960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666373.519682:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3278:x1875552186248960:12345-0@lo:400:kworker.0 Request processed in 35us (3482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666373.519686:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788666373.519698:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788666373.519703:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875552186248832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666373.519726:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3278:x1875552186248832:12345-0@lo:400:kworker.0 Request processed in 23us (3484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666373.519730:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788666373.519766:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae724e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3278:1875552186248832:0@lo:400:kworker.0 00000100:00100000:0.0:1788666373.519777:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3278:1875552186248960:0@lo:400:kworker.0 00000100:00100000:0.0:1788666373.519816:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186249088:0@lo:400:kworker.0 00000100:00100000:0.0:1788666373.519868:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186249216 00000100:00100000:0.0:1788666373.519873:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186249216 00000100:00100000:0.0:1788666373.519907:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788666373.519914:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186249216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788666373.519948:0:15028:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788666373.519988:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186249216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (3456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666373.519995:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788666373.520027:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186249216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788666373.520072:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186248704 00000100:00100000:0.0:1788666373.520075:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186248704 00000100:00100000:0.0:1788666373.520107:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788666373.520113:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186248704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666373.520169:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3275:x1875552186248704:12345-0@lo:400:kworker.0 Request processed in 57us (4030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666373.520176:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788666373.520211:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3275:1875552186248704:0@lo:400:kworker.0 00000100:00080000:0.0:1788666373.520241:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788666373.520246:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666373.520262:0:14333:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186248576 00000100:00100000:0.0:1788666373.520266:0:14333:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186248576 00000100:00100000:0.0:1788666373.520290:0:14333:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788666373.520296:0:14333:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c10b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:3275:x1875552186248576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666373.520343:0:14333:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c10b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:3275:x1875552186248576:12345-0@lo:400:kworker.0 Request processed in 47us (4299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666373.520349:0:14333:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788666373.520391:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3275:1875552186248576:0@lo:400:kworker.0 00000100:00100000:0.0:1788666374.470688:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666374.470879:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173672960 00000100:00100000:2.0:1788666374.470889:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173672960 00000100:00100000:2.0:1788666374.470971:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:2.0:1788666374.470982:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a312b542-833a-4024-a333-5685ada48983+6:14445:x1875552173672960:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788666374.471004:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666374.471028:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eae15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42d4c expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471119:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4e00/0x96bbe788361eae1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471133:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4e00/0x96bbe788361eae1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471150:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4e00/0x96bbe788361eae1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471165:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eae23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471172:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eae23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471179:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eae23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471510:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4a00/0x96bbe788361eae2a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471518:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4a00/0x96bbe788361eae2a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471525:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4a00/0x96bbe788361eae2a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666374.471549:0:14343:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788666374.471552:0:14343:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788666374.471622:0:14343:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4a00/0x96bbe788361eae2a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471644:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4e00/0x96bbe788361eae1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471651:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4e00/0x96bbe788361eae1c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471658:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4e00/0x96bbe788361eae1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471663:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4e00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666374.471667:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4e00/0x96bbe788361eae1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471674:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4e00/0x96bbe788361eae1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471686:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:2.0:1788666374.471689:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666374.471693:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4e00/0x96bbe788361eae1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471699:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4e00/0x96bbe788361eae1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471709:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eae23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471715:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eae23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471722:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eae23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471732:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666374.471736:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eae23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471742:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eae23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471751:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8ab2a402c100) 00010000:00010000:2.0:1788666374.471753:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666374.471756:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eae23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471763:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eae23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471795:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eae15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d4c expref: 8 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471808:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4a00/0x96bbe788361eae2a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d4c expref: 7 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.471815:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ab2a402cf00) 00010000:00010000:2.0:1788666374.471817:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788666374.471819:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd4a00, rc 0) 00000100:00100000:2.0:1788666374.471895:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a312b542-833a-4024-a333-5685ada48983+7:14445:x1875552173672960:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 915us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666374.471905:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00080000:0.0:1788666374.472041:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788666374.474940:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666374.475079:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173673216 00000100:00100000:0.0:1788666374.475090:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173673216 00000100:00100000:0.0:1788666374.475156:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:0.0:1788666374.475178:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a312b542-833a-4024-a333-5685ada48983+7:14445:x1875552173673216:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788666374.475199:0:15046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666374.475219:0:15046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361eae31 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42d53 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.475312:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae38 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.475328:0:15046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae38 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.475340:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae38 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.475398:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361eae3f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.475407:0:15046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361eae3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.475414:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361eae3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.475792:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e000/0x96bbe788361eae46 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.475808:0:15046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e000/0x96bbe788361eae46 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.475816:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e000/0x96bbe788361eae46 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666374.475828:0:15046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788666374.476053:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae38 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.476062:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae38 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.476069:0:15046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae38 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.476075:0:15046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2bfa7fa00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666374.476079:0:15046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae38 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.476086:0:15046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae38 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.476098:0:15046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8ab2a402cf00) 00010000:00010000:0.0:1788666374.476100:0:15046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666374.476105:0:15046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae38 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.476110:0:15046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae38 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.476123:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361eae3f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.476135:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361eae3f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.476140:0:15046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361eae3f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.476145:0:15046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2bfa7ec00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666374.476148:0:15046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361eae3f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.476154:0:15046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361eae3f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.476162:0:15046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8ab290a48500) 00010000:00010000:0.0:1788666374.476165:0:15046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666374.476167:0:15046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361eae3f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.476173:0:15046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361eae3f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.476682:0:15046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361eae31 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d53 expref: 10 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.476700:0:15046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e000/0x96bbe788361eae46 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d53 expref: 9 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.476708:0:15046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab290a48100) 00010000:00010000:0.0:1788666374.476711:0:15046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666374.476720:0:15046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2bfa7e000, rc 0) 00000100:00100000:0.0:1788666374.477516:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a312b542-833a-4024-a333-5685ada48983+9:14445:x1875552173673216:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 2346us (2579us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788666374.477527:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:3.0:1788666374.483097:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666374.483209:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173673344 00000100:00100000:2.0:1788666374.483220:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173673344 00000100:00100000:2.0:1788666374.483301:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:2.0:1788666374.483313:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae27ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a312b542-833a-4024-a333-5685ada48983+9:14445:x1875552173673344:12345-192.168.201.25@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788666374.483433:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae27ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a312b542-833a-4024-a333-5685ada48983+9:14445:x1875552173673344:12345-192.168.201.25@tcp:59:lhsmtool_posix.0 Request processed in 123us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666374.483441:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:1.0:1788666374.534127:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666374.534430:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173673472 00000100:00100000:0.0:1788666374.534441:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173673472 00000100:00100000:0.0:1788666374.534506:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:0.0:1788666374.534518:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a312b542-833a-4024-a333-5685ada48983+9:14451:x1875552173673472:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788666374.534540:0:15046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666374.534561:0:15046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361eae54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42d5a expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.534908:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae5b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.534924:0:15046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.534936:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.534950:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eae62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.534957:0:15046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eae62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.534963:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eae62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.535164:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae5b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.535246:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae5b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.535255:0:15046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.535261:0:15046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2bfa7fa00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666374.535265:0:15046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae5b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.535274:0:15046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae5b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.535300:0:15046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:0.0:1788666374.535303:0:15046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666374.535308:0:15046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.535315:0:15046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.535329:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eae62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.535335:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eae62 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.535341:0:15046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eae62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.535346:0:15046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2bfa7ee00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666374.535355:0:15046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eae62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.535362:0:15046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eae62 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.535371:0:15046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ab290a48500) 00010000:00010000:0.0:1788666374.535373:0:15046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666374.535444:0:15046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eae62 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.535452:0:15046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eae62 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.535488:0:15046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361eae54 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d5a expref: 10 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.535499:0:15046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:0.0:1788666374.535501:0:15046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666374.535505:0:15046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361eae54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d5a expref: 10 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.535514:0:15046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2bfa7ec00, rc 0) 00000100:00100000:0.0:1788666374.535721:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a312b542-833a-4024-a333-5685ada48983+9:14451:x1875552173673472:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1205us (1603us total) trans 0 rc 301/301 00000100:00100000:0.0:1788666374.535730:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:3.0:1788666374.540270:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666374.540748:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173673600 00000100:00100000:2.0:1788666374.540757:0:14350:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173673600 00000100:00100000:2.0:1788666374.540797:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:2.0:1788666374.540805:0:14350:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae27b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a312b542-833a-4024-a333-5685ada48983+9:14451:x1875552173673600:12345-192.168.201.25@tcp:700:lfs.0 00000100:00100000:2.0:1788666374.552079:0:14350:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae27b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a312b542-833a-4024-a333-5685ada48983+9:14451:x1875552173673600:12345-192.168.201.25@tcp:700:lfs.0 Request processed in 11259us (11805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666374.552100:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00010000:00010000:3.0:1788666374.556746:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666374.562058:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666374.562088:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173673856 00000100:00100000:3.0:1788666374.562097:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173673856 00000100:00100000:3.0:1788666374.562147:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 19 00000100:00100000:3.0:1788666374.562157:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae27b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a312b542-833a-4024-a333-5685ada48983+9:14451:x1875552173673856:12345-192.168.201.25@tcp:36:lfs.0 00010000:00010000:3.0:1788666374.562213:0:14342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666374.562238:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab298855a00/0x96bbe788361ead97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42cd5 expref: 9 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.562259:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:3.0:1788666374.562264:0:14342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788666374.562463:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eae69 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.562478:0:14342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eadcf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d37 expref: 5 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.562487:0:14342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eae69 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.562517:0:14342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eadcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d37 expref: 5 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.562530:0:14342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eadcf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d37 expref: 5 pid: 14341 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666374.562545:0:14342:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae278380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14342:1875552186249344:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788666374.562647:0:14342:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab284f60180 going to sleep for 11 seconds 00000100:00100000:3.0:1788666374.565107:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666374.565162:0:14342:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae278380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14342:1875552186249344:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788666374.565186:0:14342:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eae69 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666374.565222:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173673984 00000100:00100000:3.0:1788666374.565227:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173673984 00010000:00010000:3.0:1788666374.565270:0:14328:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eadcf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d37 expref: 6 pid: 14341 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666374.565319:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:3.0:1788666374.565328:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae278700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d4f8905-33ad-4a53-acca-61c229032b2c+6:2364:x1875552173673984:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666374.565342:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666374.565349:0:14328:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eadcf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d37 expref: 6 pid: 14341 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.565359:0:14328:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eadcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d37 expref: 6 pid: 14341 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.565842:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eadcf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d37 expref: 6 pid: 14341 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.565859:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:3.0:1788666374.565864:0:14328:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eae69 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.565875:0:14328:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eae69 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.565899:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eae69 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.565920:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666374.565962:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae278700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6d4f8905-33ad-4a53-acca-61c229032b2c+5:2364:x1875552173673984:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 635us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666374.565970:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00080000:3.0:1788666374.565991:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788666374.566003:0:14342:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eae69 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.566010:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eae69 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.566028:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361eae70 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.566037:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361eae70 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.566044:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361eae70 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666374.571226:0:14342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788666374.571247:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eae69 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.571259:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eae69 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.571266:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eae69 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.571280:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e9e00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666374.571299:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eae69 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.571308:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eae69 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.571325:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab2908f2000) 00010000:00010000:3.0:1788666374.571329:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666374.571335:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eae69 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.571340:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eae69 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788666374.571359:0:14342:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e19b1c19 reply state 0000000017e7d0d7 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361eae70 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666374.571368:0:14342:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788666374.571474:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae27b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a312b542-833a-4024-a333-5685ada48983+10:14451:x1875552173673856:12345-192.168.201.25@tcp:36:lfs.0 Request processed in 9315us (9421us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788666374.571483:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 19 00010000:00010000:1.0:1788666374.578138:0:3261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361eae70 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666374.578157:0:3261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361eae70 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666374.578165:0:3261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361eae70 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666374.578197:0:3261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e9200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:1.0:1788666374.578203:0:3261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361eae70 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666374.578210:0:3261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361eae70 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666374.578228:0:3261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ab2b9e72500) 00010000:00010000:1.0:1788666374.578231:0:3261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788666374.578237:0:3261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361eae70 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666374.578244:0:3261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361eae70 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788666374.579619:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934593 is committed 00000100:00100000:2.0:1788666374.679259:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666374.679388:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173674112 00000100:00100000:0.0:1788666374.679400:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173674112 00000100:00100000:0.0:1788666374.679457:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:0.0:1788666374.679467:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+8:14459:x1875552173674112:12345-192.168.201.25@tcp:101:lctl.0 00010000:00010000:0.0:1788666374.679506:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666374.679529:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eae77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42d61 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.679648:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae7e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.679662:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.679673:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666374.679709:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788666374.679714:0:14341:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788666374.679750:0:14341:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae7e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.679775:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eae77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d61 expref: 10 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.679795:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fa00/0x96bbe788361eae7e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d61 expref: 9 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.679804:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab290a48500) 00010000:00010000:0.0:1788666374.679807:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788666374.679810:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2bfa7fa00, rc 0) 00000100:00100000:0.0:1788666374.679875:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+9:14459:x1875552173674112:12345-192.168.201.25@tcp:101:lctl.0 Request processed in 409us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666374.679882:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 20 00000100:00100000:3.0:1788666374.719496:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666374.719678:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173674240 00000100:00100000:2.0:1788666374.719690:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173674240 00000100:00100000:2.0:1788666374.719758:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:2.0:1788666374.719768:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d4f8905-33ad-4a53-acca-61c229032b2c+5:14460:x1875552173674240:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666374.719792:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666374.719813:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eae85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42d68 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.719874:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4e00/0x96bbe788361eae8c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.719887:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4e00/0x96bbe788361eae8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.719915:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4e00/0x96bbe788361eae8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666374.719954:0:14343:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788666374.719958:0:14343:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788666374.719976:0:14343:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4e00/0x96bbe788361eae8c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.719998:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eae85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d68 expref: 7 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.720016:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4e00/0x96bbe788361eae8c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d68 expref: 6 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.720024:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab290a48500) 00010000:00010000:2.0:1788666374.720026:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788666374.720029:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd4e00, rc 0) 00000100:00100000:2.0:1788666374.720094:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d4f8905-33ad-4a53-acca-61c229032b2c+6:14460:x1875552173674240:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 327us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666374.720101:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 21 00000100:00100000:3.0:1788666374.723796:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666374.724605:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173674368 00000100:00100000:0.0:1788666374.724616:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173674368 00000100:00100000:0.0:1788666374.724992:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:0.0:1788666374.725004:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae27aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d4f8905-33ad-4a53-acca-61c229032b2c+6:14460:x1875552173674368:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788666374.725026:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666374.725047:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f200/0x96bbe788361eae93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42d6f expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725115:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eae9a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725130:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eae9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725142:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eae9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725157:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eaea1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725164:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eaea1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725170:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eaea1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725278:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361eaea8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725306:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361eaea8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725332:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361eaea8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666374.725364:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788666374.725369:0:14341:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788666374.725404:0:14341:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361eaea8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725416:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eae9a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725422:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eae9a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725428:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eae9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725434:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2bfa7ee00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666374.725437:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eae9a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725445:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eae9a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725456:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab290a48500) 00010000:00010000:0.0:1788666374.725459:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666374.725464:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eae9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725470:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eae9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725493:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eaea1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725499:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eaea1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725504:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eaea1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725509:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2bfa7f600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666374.725511:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eaea1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725517:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eaea1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725524:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ab290a48f00) 00010000:00010000:0.0:1788666374.725526:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666374.725529:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eaea1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725535:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eaea1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.725569:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f200/0x96bbe788361eae93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d6f expref: 8 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.726322:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361eaea8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d6f expref: 7 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.726349:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab290a48200) 00010000:00010000:0.0:1788666374.726352:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788666374.726355:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2bfa7ec00, rc 0) 00000100:00100000:0.0:1788666374.726445:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae27aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d4f8905-33ad-4a53-acca-61c229032b2c+7:14460:x1875552173674368:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1442us (2659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666374.726455:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 22 00000100:00100000:0.0:1788666374.731931:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666374.732010:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173674624 00000100:00100000:2.0:1788666374.732020:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173674624 00000100:00100000:2.0:1788666374.732069:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:2.0:1788666374.732079:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d4f8905-33ad-4a53-acca-61c229032b2c+7:14460:x1875552173674624:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666374.732102:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666374.732122:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaeaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42d76 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666374.732234:0:14343:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788666374.732763:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaeaf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d76 expref: 9 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.732779:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab290a48500) 00010000:00010000:2.0:1788666374.732782:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788666374.732788:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaeaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d76 expref: 9 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.740314:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd4c00, rc 0) 00000100:00100000:2.0:1788666374.740681:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6d4f8905-33ad-4a53-acca-61c229032b2c+8:14460:x1875552173674624:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 8596us (8753us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788666374.740691:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 23 00000100:00100000:3.0:1788666374.747825:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666374.747928:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173674880 00000100:00100000:2.0:1788666374.747939:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173674880 00000100:00100000:2.0:1788666374.747988:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 24 00000100:00100000:2.0:1788666374.747998:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d4f8905-33ad-4a53-acca-61c229032b2c+8:14460:x1875552173674880:12345-192.168.201.25@tcp:36:lfs.0 00010000:00010000:2.0:1788666374.748055:0:15046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666374.748081:0:15046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ec00/0x96bbe788361eaea8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d6f expref: 8 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.748104:0:15046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab290a48200) 00010000:00010000:2.0:1788666374.748115:0:15046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788666374.748138:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaebd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.748169:0:15046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaebd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.748191:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaebd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788666374.748474:0:15046:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004d469cab reply state 00000000aefd9b7a transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaebd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666374.748483:0:15046:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788666374.748491:0:15046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788666374.748602:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d4f8905-33ad-4a53-acca-61c229032b2c+9:14460:x1875552173674880:12345-192.168.201.25@tcp:36:lfs.0 Request processed in 604us (786us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788666374.748609:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 24 00010000:00010000:0.0:1788666374.750821:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaebd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.750839:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaebd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.750848:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaebd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.750854:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666374.750859:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaebd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.750867:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaebd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.750883:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab2a402c100) 00010000:00010000:0.0:1788666374.750886:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788666374.750890:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaebd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.750896:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaebd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666374.751686:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666374.752539:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173675136 00000100:00100000:2.0:1788666374.752551:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173675136 00000100:00100000:2.0:1788666374.752645:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:2.0:1788666374.752655:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae27a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d4f8905-33ad-4a53-acca-61c229032b2c+8:14460:x1875552173675136:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:2.0:1788666374.752889:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae27a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d4f8905-33ad-4a53-acca-61c229032b2c+9:14460:x1875552173675136:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 235us (1208us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788666374.752897:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:3.0:1788666374.755460:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666374.755623:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173675392 00000100:00100000:0.0:1788666374.755640:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173675392 00000100:00100000:0.0:1788666374.755692:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:0.0:1788666374.755702:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae27b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d4f8905-33ad-4a53-acca-61c229032b2c+9:14460:x1875552173675392:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:0.0:1788666374.755728:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666374.755750:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f200/0x96bbe788361eaec4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42d7d expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.755830:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eaecb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.755845:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eaecb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.755856:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eaecb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.755870:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eaed2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.755878:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eaed2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.755884:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eaed2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666374.756001:0:14342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788666374.756096:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eaecb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.756125:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eaecb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.756132:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eaecb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.756138:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2bfa7f600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666374.756143:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eaecb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.756150:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eaecb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.756162:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab290a48500) 00010000:00010000:0.0:1788666374.756165:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666374.756170:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eaecb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.756176:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eaecb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.756193:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eaed2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.756198:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eaed2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.756204:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eaed2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.756209:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2bfa7ee00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666374.756219:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eaed2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.756226:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eaed2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.756233:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ab290a48f00) 00010000:00010000:0.0:1788666374.756236:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666374.756238:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eaed2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.756243:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eaed2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.756517:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f200/0x96bbe788361eaec4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d7d expref: 11 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.756530:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab290a48500) 00010000:00010000:0.0:1788666374.756532:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788666374.756537:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f200/0x96bbe788361eaec4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d7d expref: 11 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.756549:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2bfa7f200, rc 0) 00000100:00100000:0.0:1788666374.756843:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae27b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6d4f8905-33ad-4a53-acca-61c229032b2c+10:14460:x1875552173675392:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 1140us (1389us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788666374.756852:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 25 00000100:00100000:3.0:1788666374.764452:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666374.764632:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173675520 00000100:00100000:2.0:1788666374.764653:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173675520 00000100:00100000:2.0:1788666374.764716:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00100000:2.0:1788666374.764726:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d4f8905-33ad-4a53-acca-61c229032b2c+10:14460:x1875552173675520:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666374.764751:0:15046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666374.764775:0:15046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaee0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42d84 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.764882:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaee7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.764897:0:15046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaee7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.764909:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaee7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666374.764934:0:15046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788666374.764938:0:15046:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788666374.764954:0:15046:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaee7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.764981:0:15046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaee0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d84 expref: 12 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.764998:0:15046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaee7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d84 expref: 11 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.765006:0:15046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab2a402ce00) 00010000:00010000:2.0:1788666374.765008:0:15046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788666374.765011:0:15046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd4200, rc 0) 00000100:00100000:2.0:1788666374.765073:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6d4f8905-33ad-4a53-acca-61c229032b2c+11:14460:x1875552173675520:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 348us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666374.765081:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 26 00000100:00100000:3.0:1788666374.771139:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666374.771852:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173675648 00000100:00100000:2.0:1788666374.771868:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173675648 00000100:00100000:2.0:1788666374.771939:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:2.0:1788666374.771949:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d4f8905-33ad-4a53-acca-61c229032b2c+11:14460:x1875552173675648:12345-192.168.201.25@tcp:37:lfs.0 00000100:00100000:3.0:1788666374.785128:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6d4f8905-33ad-4a53-acca-61c229032b2c+11:14460:x1875552173675648:12345-192.168.201.25@tcp:37:lfs.0 Request processed in 13170us (13988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666374.785147:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:0.0:1788666374.795880:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666374.795959:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173675904 00000100:00100000:1.0:1788666374.795969:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173675904 00000100:00100000:1.0:1788666374.796050:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:1.0:1788666374.796061:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4812c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d4f8905-33ad-4a53-acca-61c229032b2c+11:14460:x1875552173675904:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:1.0:1788666374.796458:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4812c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6d4f8905-33ad-4a53-acca-61c229032b2c+12:14460:x1875552173675904:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 398us (586us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788666374.796467:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:1.0:1788666374.882763:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666374.882936:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173676032 00000100:00100000:0.0:1788666374.882947:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173676032 00000100:00100000:0.0:1788666374.883020:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:0.0:1788666374.883045:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a312b542-833a-4024-a333-5685ada48983+9:14466:x1875552173676032:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:0.0:1788666374.883067:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788666374.883089:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eaeee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42d8b expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.883158:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fe00/0x96bbe788361eaef5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.883182:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fe00/0x96bbe788361eaef5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.883194:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fe00/0x96bbe788361eaef5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.883208:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361eaefc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.883215:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361eaefc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.883221:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361eaefc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.883322:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eaf03 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.883330:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eaf03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.883337:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eaf03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788666374.883627:0:14342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788666374.883632:0:14342:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788666374.883670:0:14342:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eaf03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.883683:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fe00/0x96bbe788361eaef5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.883690:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fe00/0x96bbe788361eaef5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.883703:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fe00/0x96bbe788361eaef5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.883709:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2bfa7fe00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666374.883713:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fe00/0x96bbe788361eaef5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.883720:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fe00/0x96bbe788361eaef5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.883731:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab290a48500) 00010000:00010000:0.0:1788666374.883735:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666374.883739:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fe00/0x96bbe788361eaef5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.883745:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7fe00/0x96bbe788361eaef5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.883759:0:14342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361eaefc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.883775:0:14342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361eaefc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.883979:0:14342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361eaefc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.883985:0:14342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2bfa7e200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666374.883988:0:14342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361eaefc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.883994:0:14342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361eaefc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.884003:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8ab290a48f00) 00010000:00010000:0.0:1788666374.884006:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788666374.884009:0:14342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361eaefc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.884014:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7e200/0x96bbe788361eaefc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.884049:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7f600/0x96bbe788361eaeee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d8b expref: 11 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.884063:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2bfa7ee00/0x96bbe788361eaf03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d8b expref: 10 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666374.884070:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab2a402ce00) 00010000:00010000:0.0:1788666374.884073:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788666374.884085:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2bfa7ee00, rc 0) 00000100:00100000:0.0:1788666374.884268:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a312b542-833a-4024-a333-5685ada48983+10:14466:x1875552173676032:12345-192.168.201.25@tcp:101:bash.0 Request processed in 1224us (1513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666374.884277:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 27 00000100:00100000:0.0:1788666374.890541:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666374.890797:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173676288 00000100:00100000:2.0:1788666374.890806:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173676288 00000100:00100000:2.0:1788666374.890863:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 28 00000100:00100000:2.0:1788666374.890873:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a312b542-833a-4024-a333-5685ada48983+10:14466:x1875552173676288:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:2.0:1788666374.890894:0:15046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666374.890914:0:15046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf0a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42d92 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.891026:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf11 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.891041:0:15046:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaee7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d84 expref: 11 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.891050:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf11 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.891083:0:15046:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaee7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d84 expref: 11 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.891096:0:15046:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaee7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d84 expref: 11 pid: 15046 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666374.891110:0:15046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa77800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15046:1875552186249472:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788666374.891207:0:15046:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab28626a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788666374.894331:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666374.894624:0:16457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173676416 00000100:00100000:1.0:1788666374.894642:0:16457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173676416 00010000:00010000:1.0:1788666374.894684:0:16457:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaee7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d84 expref: 12 pid: 15046 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666374.894745:0:16457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:1.0:1788666374.894755:0:16457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae279f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d4f8905-33ad-4a53-acca-61c229032b2c+12:2363:x1875552173676416:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666374.894771:0:16457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666374.894778:0:16457:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaee7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d84 expref: 12 pid: 15046 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666374.894790:0:16457:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaee7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d84 expref: 12 pid: 15046 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666374.894812:0:16457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab2a402ce00) 00010000:00010000:1.0:1788666374.894817:0:16457:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf11 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666374.894827:0:16457:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf11 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666374.894835:0:16457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf11 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666374.894853:0:16457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666374.894959:0:16457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae279f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6d4f8905-33ad-4a53-acca-61c229032b2c+12:2363:x1875552173676416:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 205us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666374.894967:0:16457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00010000:00010000:2.0:1788666374.895155:0:15046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaee7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d84 expref: 11 pid: 15046 timeout: 581 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666374.895189:0:15046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa77800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15046:1875552186249472:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666374.895209:0:15046:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf11 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.895218:0:15046:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf11 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.895224:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf11 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.895246:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4600/0x96bbe788361eaf18 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.895255:0:15046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4600/0x96bbe788361eaf18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.895263:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4600/0x96bbe788361eaf18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.896200:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf1f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.896212:0:15046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.896221:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf1f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666374.896234:0:15046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788666374.896263:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf11 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.896290:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf11 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.896298:0:15046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf11 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.896304:0:15046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4000 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666374.896309:0:15046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf11 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.896316:0:15046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf11 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.896328:0:15046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab2a402ce00) 00010000:00010000:2.0:1788666374.896331:0:15046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666374.896335:0:15046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf11 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.896341:0:15046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf11 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788666374.896353:0:15046:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb110552 reply state 000000008a6f2d41 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4600/0x96bbe788361eaf18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666374.896361:0:15046:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788666374.896395:0:15046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf0a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d92 expref: 13 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.896409:0:15046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d92 expref: 12 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.896429:0:15046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab2a402c100) 00010000:00010000:2.0:1788666374.896431:0:15046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788666374.896433:0:15046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd5200, rc 0) 00000100:00100000:2.0:1788666374.896484:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a312b542-833a-4024-a333-5685ada48983+13:14466:x1875552173676288:12345-192.168.201.25@tcp:101:bash.0 Request processed in 5613us (5952us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788666374.896492:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 28 00010000:00010000:3.0:1788666374.902127:0:3261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4600/0x96bbe788361eaf18 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.902145:0:3261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4600/0x96bbe788361eaf18 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.902154:0:3261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4600/0x96bbe788361eaf18 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.902160:0:3261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4600 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666374.902165:0:3261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4600/0x96bbe788361eaf18 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.902181:0:3261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4600/0x96bbe788361eaf18 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.902200:0:3261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8ab2a402c400) 00010000:00010000:3.0:1788666374.902203:0:3261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666374.902209:0:3261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4600/0x96bbe788361eaf18 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666374.902215:0:3261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4600/0x96bbe788361eaf18 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666374.917111:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666374.917939:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173676544 00000100:00100000:2.0:1788666374.917953:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173676544 00000100:00100000:2.0:1788666374.918029:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 29 00000100:00100000:2.0:1788666374.918041:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a312b542-833a-4024-a333-5685ada48983+12:14466:x1875552173676544:12345-192.168.201.25@tcp:101:bash.0 00010000:00010000:2.0:1788666374.918068:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666374.918089:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf2d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42d99 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.918158:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf34 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.918184:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.918197:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666374.918236:0:14343:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788666374.918241:0:14343:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788666374.918259:0:14343:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.919240:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf34 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.919291:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf2d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d99 expref: 14 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.919313:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d99 expref: 13 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666374.919321:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab2a402c100) 00010000:00010000:2.0:1788666374.919894:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666374.919901:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd4000, rc 0) 00000100:00100000:2.0:1788666374.919983:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a312b542-833a-4024-a333-5685ada48983+13:14466:x1875552173676544:12345-192.168.201.25@tcp:101:bash.0 Request processed in 1944us (2879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666374.919992:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 29 00000040:00080000:2.0:1788666374.923315:0:14373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788666374.934021:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666374.934269:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173676800 00000100:00100000:3.0:1788666374.934288:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173676800 00000100:00100000:3.0:1788666374.934754:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:3.0:1788666374.934766:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a312b542-833a-4024-a333-5685ada48983+13:14466:x1875552173676800:12345-192.168.201.25@tcp:35:bash.0 00000100:00100000:3.0:1788666374.935156:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a312b542-833a-4024-a333-5685ada48983+14:14466:x1875552173676800:12345-192.168.201.25@tcp:35:bash.0 Request processed in 392us (1980us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788666374.935165:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:0.0:1788666375.109489:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666375.109798:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173677056 00000100:00100000:2.0:1788666375.109809:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173677056 00000100:00100000:2.0:1788666375.109902:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 30 00000100:00100000:2.0:1788666375.109913:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+14:14475:x1875552173677056:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:2.0:1788666375.109941:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666375.109963:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42da0 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666375.110055:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788666375.110197:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf3b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42da0 expref: 16 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.110233:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8ab290a48500) 00010000:00010000:2.0:1788666375.110236:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788666375.110243:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42da0 expref: 16 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.110257:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd4c00, rc 0) 00000100:00100000:2.0:1788666375.110493:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+15:14475:x1875552173677056:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 580us (1179us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788666375.110502:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 30 00000100:00100000:0.0:1788666375.116102:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666375.116267:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173677312 00000100:00100000:1.0:1788666375.116289:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173677312 00000100:00100000:1.0:1788666375.116914:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:1.0:1788666375.116940:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a312b542-833a-4024-a333-5685ada48983+15:14475:x1875552173677312:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:1.0:1788666375.117208:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a312b542-833a-4024-a333-5685ada48983+16:14475:x1875552173677312:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 270us (1117us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788666375.117216:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:0.0:1788666375.167159:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666375.167488:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173677568 00000100:00100000:3.0:1788666375.167500:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173677568 00000100:00100000:3.0:1788666375.167768:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:3.0:1788666375.167780:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a312b542-833a-4024-a333-5685ada48983+16:14479:x1875552173677568:12345-192.168.201.25@tcp:101:lfs.0 00010000:00010000:3.0:1788666375.167806:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666375.167826:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eaf49 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42da7 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666375.167933:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361eaf50 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666375.167948:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361eaf50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666375.167960:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361eaf50 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788666375.167972:0:14342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788666375.168116:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eaf49 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42da7 expref: 19 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666375.168136:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361eaf50 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42da7 expref: 18 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666375.168163:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab2a402c100) 00010000:00010000:3.0:1788666375.168240:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788666375.168246:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e9800, rc 0) 00000100:00100000:3.0:1788666375.168658:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a312b542-833a-4024-a333-5685ada48983+18:14479:x1875552173677568:12345-192.168.201.25@tcp:101:lfs.0 Request processed in 878us (1506us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788666375.168666:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:0.0:1788666375.180102:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666375.180145:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666375.180218:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173677824 00000100:00100000:3.0:1788666375.180228:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173677824 00000100:00100000:3.0:1788666375.180307:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:3.0:1788666375.180318:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae725880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a312b542-833a-4024-a333-5685ada48983+18:2362:x1875552173677824:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666375.180345:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666375.180389:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361eaf50 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42da7 expref: 18 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666375.180409:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab2a402c100) 00010000:00010000:3.0:1788666375.180415:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666375.180467:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae725880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a312b542-833a-4024-a333-5685ada48983+17:2362:x1875552173677824:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 152us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666375.180475:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:2.0:1788666375.181214:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173677696 00000100:00100000:2.0:1788666375.181223:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173677696 00000100:00100000:2.0:1788666375.181265:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:2.0:1788666375.181283:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a312b542-833a-4024-a333-5685ada48983+17:14479:x1875552173677696:12345-192.168.201.25@tcp:54:lfs.0 00010000:00010000:2.0:1788666375.181360:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf5e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.181385:0:15046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.181397:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.181442:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf5e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.181450:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf5e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.181476:0:15046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.181483:0:15046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4c00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666375.181488:0:15046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf5e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.181496:0:15046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf5e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.181518:0:15046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab2a402c100) 00010000:00010000:2.0:1788666375.181522:0:15046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788666375.181526:0:15046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf5e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.181533:0:15046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf5e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666375.181610:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a312b542-833a-4024-a333-5685ada48983+17:14479:x1875552173677696:12345-192.168.201.25@tcp:54:lfs.0 Request processed in 337us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666375.181617:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 32 00000100:00100000:0.0:1788666375.187413:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666375.187727:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173678080 00000100:00100000:3.0:1788666375.187739:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173678080 00000100:00100000:3.0:1788666375.187839:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:3.0:1788666375.187850:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a312b542-833a-4024-a333-5685ada48983+17:14479:x1875552173678080:12345-192.168.201.25@tcp:35:lfs.0 00000100:00100000:3.0:1788666375.188108:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae726a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a312b542-833a-4024-a333-5685ada48983+18:14479:x1875552173678080:12345-192.168.201.25@tcp:35:lfs.0 Request processed in 260us (793us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788666375.188133:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:0.0:1788666375.480714:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666375.480873:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173678336 00000100:00100000:2.0:1788666375.480884:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173678336 00000100:00100000:2.0:1788666375.480943:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:2.0:1788666375.480952:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a312b542-833a-4024-a333-5685ada48983+18:14510:x1875552173678336:12345-192.168.201.25@tcp:101:cat.0 00010000:00010000:2.0:1788666375.480976:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666375.480996:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf65 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42dae expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.481124:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaf6c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.481138:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaf6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.481151:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaf6c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666375.481162:0:14343:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788666375.481332:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf65 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42dae expref: 21 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.481362:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaf6c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42dae expref: 20 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.481371:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab2a402c100) 00010000:00010000:2.0:1788666375.481374:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788666375.481747:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd4200, rc 0) 00000100:00100000:2.0:1788666375.481822:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a312b542-833a-4024-a333-5685ada48983+20:14510:x1875552173678336:12345-192.168.201.25@tcp:101:cat.0 Request processed in 868us (1116us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788666375.481842:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 33 00000100:00100000:0.0:1788666375.493999:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666375.494092:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173678592 00000100:00100000:1.0:1788666375.494103:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173678592 00000100:00100000:1.0:1788666375.494171:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:1.0:1788666375.494182:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a312b542-833a-4024-a333-5685ada48983+20:14510:x1875552173678592:12345-192.168.201.25@tcp:35:cat.0 00000100:00100000:1.0:1788666375.495122:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a312b542-833a-4024-a333-5685ada48983+21:14510:x1875552173678592:12345-192.168.201.25@tcp:35:cat.0 Request processed in 936us (1129us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788666375.495132:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 8 00000100:00100000:0.0:1788666375.502148:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666375.505744:0:16457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173678720 00000100:00100000:1.0:1788666375.505764:0:16457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173678720 00000100:00100000:1.0:1788666375.505858:0:16457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:1.0:1788666375.505870:0:16457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae724e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a312b542-833a-4024-a333-5685ada48983+21:2362:x1875552173678720:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788666375.505891:0:16457:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788666375.505924:0:16457:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4200/0x96bbe788361eaf6c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42dae expref: 21 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666375.505947:0:16457:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab2a402c100) 00010000:00010000:1.0:1788666375.505953:0:16457:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788666375.506029:0:16457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae724e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:a312b542-833a-4024-a333-5685ada48983+20:2362:x1875552173678720:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 160us (3891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666375.506036:0:16457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 1 00010000:00010000:3.0:1788666375.562766:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666375.576536:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666375.576736:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173678976 00000100:00100000:2.0:1788666375.576747:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173678976 00000100:00100000:2.0:1788666375.576813:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 34 00000100:00100000:2.0:1788666375.576824:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a312b542-833a-4024-a333-5685ada48983+20:14516:x1875552173678976:12345-192.168.201.25@tcp:101:dd.0 00010000:00010000:2.0:1788666375.576849:0:15046:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666375.576884:0:15046:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf7a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42db5 expref: -99 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.576987:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5e00/0x96bbe788361eaf81 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.577002:0:15046:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf1f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d92 expref: 21 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.577011:0:15046:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf34 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d99 expref: 21 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.577020:0:15046:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5e00/0x96bbe788361eaf81 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.577055:0:15046:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf34 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d99 expref: 21 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.577069:0:15046:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf34 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d99 expref: 21 pid: 14343 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666375.577084:0:15046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2bfa77800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15046:1875552186249600:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666375.577210:0:15046:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf1f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d92 expref: 21 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.577220:0:15046:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf1f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d92 expref: 21 pid: 15046 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666375.577229:0:15046:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1aba680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15046:1875552186249728:192.168.201.25@tcp:104: 00000100:00100000:2.0:1788666375.577262:0:15046:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab298371600 going to sleep for 11 seconds 00000100:00100000:0.0:1788666375.582499:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666375.582556:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666375.582731:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173679104 00000100:00100000:3.0:1788666375.582742:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173679104 00010000:00010000:3.0:1788666375.582794:0:14328:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf34 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d99 expref: 22 pid: 14343 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666375.582832:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173679232 00000100:00100000:3.0:1788666375.582835:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173679232 00010000:00010000:3.0:1788666375.582851:0:14328:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf1f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d92 expref: 23 pid: 15046 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666375.582870:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:3.0:1788666375.582878:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c10b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a312b542-833a-4024-a333-5685ada48983+23:2362:x1875552173679104:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666375.582894:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666375.582901:0:14328:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf34 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d99 expref: 23 pid: 14343 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666375.582914:0:14328:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf34 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d99 expref: 23 pid: 14343 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666375.582935:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab2a402c100) 00010000:00010000:3.0:1788666375.582940:0:14328:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5e00/0x96bbe788361eaf81 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666375.582950:0:14328:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5e00/0x96bbe788361eaf81 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666375.582967:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666375.583021:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c10b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a312b542-833a-4024-a333-5685ada48983+23:2362:x1875552173679104:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 143us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666375.583029:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:3.0:1788666375.583072:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:3.0:1788666375.583079:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a312b542-833a-4024-a333-5685ada48983+22:2362:x1875552173679232:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788666375.583087:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666375.583091:0:14328:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf1f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d92 expref: 22 pid: 15046 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666375.583101:0:14328:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf1f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d92 expref: 22 pid: 15046 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666375.583113:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab2a402c100) 00010000:00010000:3.0:1788666375.583116:0:14328:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5e00/0x96bbe788361eaf81 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666375.583124:0:14328:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5e00/0x96bbe788361eaf81 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666375.583132:0:14328:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5e00/0x96bbe788361eaf81 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666375.583147:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666375.583165:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a312b542-833a-4024-a333-5685ada48983+22:2362:x1875552173679232:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 87us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666375.583171:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00010000:00010000:2.0:1788666375.583829:0:15046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eaf34 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d99 expref: 21 pid: 14343 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666375.583849:0:15046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2bfa77800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15046:1875552186249600:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666375.583862:0:15046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf1f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42d92 expref: 20 pid: 15046 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666375.583872:0:15046:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1aba680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15046:1875552186249728:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666375.583896:0:15046:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5e00/0x96bbe788361eaf81 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.583906:0:15046:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5e00/0x96bbe788361eaf81 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.583911:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5e00/0x96bbe788361eaf81 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666375.583930:0:15046:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788666375.584125:0:15046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf7a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42db5 expref: 21 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.584142:0:15046:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5e00/0x96bbe788361eaf81 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42db5 expref: 20 pid: 15046 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.584150:0:15046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab2a402c100) 00010000:00010000:2.0:1788666375.584153:0:15046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788666375.584156:0:15046:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd5e00, rc 0) 00000100:00100000:2.0:1788666375.584227:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae278e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a312b542-833a-4024-a333-5685ada48983+20:14516:x1875552173678976:12345-192.168.201.25@tcp:101:dd.0 Request processed in 7405us (7703us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788666375.584235:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 34 00000100:00100000:0.0:1788666375.587464:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666375.587603:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173679488 00000100:00100000:2.0:1788666375.587613:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173679488 00000100:00100000:2.0:1788666375.587679:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 35 00000100:00100000:2.0:1788666375.587691:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a312b542-833a-4024-a333-5685ada48983+20:14516:x1875552173679488:12345-192.168.201.25@tcp:36:dd.0 00010000:00010000:2.0:1788666375.587969:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4800/0x96bbe788361eaf8f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.587986:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4800/0x96bbe788361eaf8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.587998:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4800/0x96bbe788361eaf8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788666375.588051:0:14343:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788666375.588089:0:14343:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a90b895 reply state 00000000ceed2850 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4800/0x96bbe788361eaf8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666375.588098:0:14343:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788666375.588196:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a312b542-833a-4024-a333-5685ada48983+23:14516:x1875552173679488:12345-192.168.201.25@tcp:36:dd.0 Request processed in 507us (743us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788666375.588204:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 35 00000020:00080000:2.0:1788666375.588209:0:14343:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788666375.590883:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00010000:00010000:3.0:1788666375.590972:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4800/0x96bbe788361eaf8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666375.590984:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4800/0x96bbe788361eaf8f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666375.590992:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4800/0x96bbe788361eaf8f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666375.590998:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666375.591003:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4800/0x96bbe788361eaf8f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666375.591010:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4800/0x96bbe788361eaf8f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666375.591026:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab2a402c100) 00010000:00010000:3.0:1788666375.591029:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666375.591034:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4800/0x96bbe788361eaf8f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666375.591039:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4800/0x96bbe788361eaf8f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666375.591109:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173679616 00000100:00100000:2.0:1788666375.591119:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173679616 00000100:00100000:2.0:1788666375.591173:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:2.0:1788666375.591182:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+22:14516:x1875552173679616:12345-192.168.201.25@tcp:101:dd.0 00010000:00010000:2.0:1788666375.591221:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666375.591239:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf96 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42dbc expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.591303:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf96 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42dbc expref: 23 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.591317:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf96 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42dbc expref: 23 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.591335:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab2a402c100) 00010000:00010000:2.0:1788666375.591338:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788666375.591341:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd4c00, rc 0) 00000100:00100000:2.0:1788666375.591407:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+23:14516:x1875552173679616:12345-192.168.201.25@tcp:101:dd.0 Request processed in 226us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666375.591414:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 36 00000100:00100000:0.0:1788666375.604442:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666375.604535:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173679872 00000100:00100000:3.0:1788666375.604548:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173679872 00000100:00100000:3.0:1788666375.604647:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:3.0:1788666375.604657:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a312b542-833a-4024-a333-5685ada48983+23:14516:x1875552173679872:12345-192.168.201.25@tcp:103:dd.0 00010000:00010000:3.0:1788666375.604674:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788666375.604700:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eaf96 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42dbc expref: 23 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666375.604739:0:14328:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab2a402c100) 00010000:00010000:3.0:1788666375.604744:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788666375.604807:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a312b542-833a-4024-a333-5685ada48983+22:14516:x1875552173679872:12345-192.168.201.25@tcp:103:dd.0 Request processed in 152us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666375.604815:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:3.0:1788666375.608035:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666375.608113:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173680000 00000100:00100000:2.0:1788666375.608123:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173680000 00000100:00100000:2.0:1788666375.608186:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00100000:2.0:1788666375.608197:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a312b542-833a-4024-a333-5685ada48983+22:14516:x1875552173680000:12345-192.168.201.25@tcp:58:dd.0 00010000:00010000:2.0:1788666375.608310:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf9d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.608327:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf9d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.608339:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf9d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788666375.609144:0:14343:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788666375.609306:0:14343:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788666375.609374:0:14343:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788666375.609483:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a312b542-833a-4024-a333-5685ada48983+22:14516:x1875552173680000:12345-192.168.201.25@tcp:58:dd.0 Request processed in 1286us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666375.609493:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 37 00000100:00100000:1.0:1788666375.616729:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666375.616987:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173680128 00000100:00100000:2.0:1788666375.616997:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173680128 00000100:00100000:2.0:1788666375.617052:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 38 00000100:00100000:2.0:1788666375.617062:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+22:14516:x1875552173680128:12345-192.168.201.25@tcp:101:dd.0 00010000:00010000:2.0:1788666375.617083:0:14341:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666375.617102:0:14341:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eafa4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42dc3 expref: -99 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.617171:0:14341:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf9d lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.617183:0:14341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eafa4 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42dc3 expref: 23 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.617201:0:14341:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf9d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.617214:0:14341:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eafa4 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42dc3 expref: 23 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.617227:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab2a402c100) 00010000:00010000:2.0:1788666375.617239:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788666375.617243:0:14341:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eafa4 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42dc3 expref: 23 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.617251:0:14341:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd4000, rc 0) 00000100:00100000:2.0:1788666375.617320:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+23:14516:x1875552173680128:12345-192.168.201.25@tcp:101:dd.0 Request processed in 260us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666375.617327:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 38 00000040:00080000:2.0:1788666375.947216:0:14373:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788666375.947226:0:14373:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788666375.947313:0:14373:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788666375.947319:0:14373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788666375.947444:0:14373:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1aba680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14373:1875552186249856:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788666375.947560:0:14373:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29053ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788666375.952039:0:14373:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1aba680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14373:1875552186249856:192.168.201.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788666375.953374:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666375.957367:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173680256 00000100:00100000:2.0:1788666375.957385:0:14352:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173680256 00000100:00100000:2.0:1788666375.957503:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:2.0:1788666375.957514:0:14352:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a312b542-833a-4024-a333-5685ada48983+23:14517:x1875552173680256:12345-192.168.201.25@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788666375.957631:0:14352:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a312b542-833a-4024-a333-5685ada48983+23:14517:x1875552173680256:12345-192.168.201.25@tcp:900:lhsmtool_posix.0 Request processed in 119us (4261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666375.957638:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:1.0:1788666375.960642:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666375.961551:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173680384 00000100:00100000:3.0:1788666375.961563:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173680384 00000100:00100000:3.0:1788666375.961773:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:3.0:1788666375.961786:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a312b542-833a-4024-a333-5685ada48983+23:14517:x1875552173680384:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788666375.961891:0:14342:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788666375.962406:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a312b542-833a-4024-a333-5685ada48983+23:14517:x1875552173680384:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 620us (1771us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666375.970287:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 39 00000100:00100000:0.0:1788666375.977533:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666375.977641:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173680512 00000100:00100000:2.0:1788666375.977658:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173680512 00000100:00100000:2.0:1788666375.977717:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:2.0:1788666375.977728:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+23:14517:x1875552173680512:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788666375.977839:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5000/0x96bbe788361eafab lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.977857:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5000/0x96bbe788361eafab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.977868:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5000/0x96bbe788361eafab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.977902:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eafb2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.977910:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eafb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.977917:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eafb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.977952:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafb9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.977960:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.977967:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666375.978023:0:14341:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788666375.978028:0:14341:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788666375.978040:0:14341:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.978050:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5000/0x96bbe788361eafab lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.978063:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5000/0x96bbe788361eafab lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.978071:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5000/0x96bbe788361eafab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.978076:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd5000 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666375.978080:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5000/0x96bbe788361eafab lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.978088:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5000/0x96bbe788361eafab lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.978101:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab290a48100) 00010000:00010000:2.0:1788666375.978105:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666375.978110:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5000/0x96bbe788361eafab lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.978116:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5000/0x96bbe788361eafab lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.978131:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eafb2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.978137:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eafb2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.978144:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eafb2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.978148:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd5400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666375.978157:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eafb2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.978164:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eafb2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.978172:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8ab2a402c900) 00010000:00010000:2.0:1788666375.978174:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666375.978177:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eafb2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.978183:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eafb2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.978199:0:14341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafb9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.978204:0:14341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafb9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.978209:0:14341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafb9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.978215:0:14341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666375.978218:0:14341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafb9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.978224:0:14341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafb9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.978231:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab2a402c100) 00010000:00010000:2.0:1788666375.978233:0:14341:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666375.978242:0:14341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafb9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.978247:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafb9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666375.978340:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+23:14517:x1875552173680512:12345-192.168.201.25@tcp:34:lhsmtool_posix.0 Request processed in 612us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666375.978349:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 40 00000100:00100000:0.0:1788666375.989926:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666375.990492:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173680768 00000100:00100000:2.0:1788666375.990503:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173680768 00000100:00100000:2.0:1788666375.990866:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 41 00000100:00100000:2.0:1788666375.990878:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a312b542-833a-4024-a333-5685ada48983+23:14517:x1875552173680768:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788666375.990901:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666375.990921:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafc0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42dca expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.991045:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eafc7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.991062:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eafc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.991074:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eafc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666375.991085:0:14343:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788666375.991186:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eafc7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.991194:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eafc7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.991213:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eafc7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.991219:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd5400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666375.991223:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eafc7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.991231:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eafc7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.991242:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab2a402c100) 00010000:00010000:2.0:1788666375.991245:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788666375.991250:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eafc7 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.991255:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eafc7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.991340:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafc0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42dca expref: 25 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.991350:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8ab290a48100) 00010000:00010000:2.0:1788666375.991352:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788666375.991356:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafc0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42dca expref: 25 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666375.991365:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd4400, rc 0) 00000100:00100000:2.0:1788666375.991426:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a312b542-833a-4024-a333-5685ada48983+24:14517:x1875552173680768:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 551us (1510us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788666375.991444:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 41 00000100:00100000:1.0:1788666375.994246:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666375.994371:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173680896 00000100:00100000:2.0:1788666375.994381:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173680896 00000100:00100000:2.0:1788666375.994442:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:2.0:1788666375.994451:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+24:14517:x1875552173680896:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788666375.994484:0:14341:0:(mdt_handler.c:7973:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788666375.994887:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+24:14517:x1875552173680896:12345-192.168.201.25@tcp:53:lhsmtool_posix.0 Request processed in 436us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666375.994971:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 42 00000100:00100000:0.0:1788666375.997970:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666375.998227:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173681152 00000100:00100000:3.0:1788666375.998235:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173681152 00000100:00100000:3.0:1788666375.998299:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:3.0:1788666375.998309:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a312b542-833a-4024-a333-5685ada48983+24:14517:x1875552173681152:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788666375.998328:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666375.998348:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361eafd5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42dd1 expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788666375.999547:0:14342:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:3.0:1788666375.999556:0:14342:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1788666376.000153:0:14342:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1788666376.001397:0:14342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eafdc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.001419:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eafdc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.001432:0:14342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eafdc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.004125:0:14342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361eafd5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42dd1 expref: 27 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.004163:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eafdc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42dd1 expref: 26 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.004173:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab2b9e72000) 00010000:00010000:3.0:1788666376.004176:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788666376.004180:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e9e00, rc 0) 00000100:00100000:3.0:1788666376.004326:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a312b542-833a-4024-a333-5685ada48983+26:14517:x1875552173681152:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 6017us (6362us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1788666376.004336:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 43 00000100:00100000:0.0:1788666376.010004:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666376.010143:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173681408 00000100:00100000:2.0:1788666376.010153:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173681408 00000100:00100000:2.0:1788666376.010221:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:2.0:1788666376.010229:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a312b542-833a-4024-a333-5685ada48983+26:14517:x1875552173681408:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788666376.010296:0:15046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666376.010323:0:15046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eafdc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42dd1 expref: 26 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.010345:0:15046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab2b9e72000) 00010000:00010000:2.0:1788666376.010356:0:15046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788666376.010378:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafea lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.010391:0:15046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.010401:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788666376.011379:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788666376.012369:0:15046:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eaff1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc5d1d091 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.012389:0:15046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eaff1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5d1d091 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.012399:0:15046:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eaff1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5d1d091 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.012469:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.012477:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafea lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.012483:0:15046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafea lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.012489:0:15046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666376.012493:0:15046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafea lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.012500:0:15046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafea lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.012523:0:15046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8ab2a402ce00) 00010000:00010000:2.0:1788666376.012526:0:15046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666376.012530:0:15046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafea lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.012536:0:15046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4400/0x96bbe788361eafea lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.012564:0:15046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eaff1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5d1d091 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.012569:0:15046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eaff1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5d1d091 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.012574:0:15046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eaff1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5d1d091 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.012616:0:15046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd5400 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:2.0:1788666376.012619:0:15046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eaff1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5d1d091 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.012625:0:15046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eaff1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc5d1d091 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.012633:0:15046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xc5d1d091 (ffff8ab2a402c900) 00010000:00010000:2.0:1788666376.012635:0:15046:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788666376.012638:0:15046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eaff1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc5d1d091 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.012643:0:15046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eaff1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc5d1d091 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15046 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666376.012942:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a312b542-833a-4024-a333-5685ada48983+25:14517:x1875552173681408:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 2709us (2942us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788666376.012952:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 44 00000100:00100000:3.0:1788666376.015913:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666376.016276:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173681536 00000100:00100000:2.0:1788666376.016286:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173681536 00000100:00100000:2.0:1788666376.016342:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:2.0:1788666376.016361:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a312b542-833a-4024-a333-5685ada48983+25:14517:x1875552173681536:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788666376.016380:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666376.016397:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5000/0x96bbe788361eaff8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42dd8 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.016423:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5600/0x96bbe788361eafff lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.016434:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5600/0x96bbe788361eafff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.016443:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5600/0x96bbe788361eafff lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.016525:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5000/0x96bbe788361eaff8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42dd8 expref: 27 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.016538:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5600/0x96bbe788361eafff lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42dd8 expref: 26 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.016545:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab2a402ca00) 00010000:00010000:2.0:1788666376.016548:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788666376.016550:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd5600, rc 0) 00000100:00100000:2.0:1788666376.017426:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a312b542-833a-4024-a333-5685ada48983+26:14517:x1875552173681536:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 1061us (1519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666376.017437:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 45 00000100:00100000:0.0:1788666376.020007:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666376.020150:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173681792 00000100:00100000:2.0:1788666376.020160:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173681792 00000100:00100000:2.0:1788666376.020214:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 46 00000100:00100000:2.0:1788666376.020234:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+26:14517:x1875552173681792:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788666376.020336:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eb006 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.020354:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eb006 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.020367:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eb006 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788666376.022043:0:14341:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1788666376.022060:0:14341:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 482730479374ns, next at 483730476393ns, rc = 0 00000004:00010000:0.0:1788666376.022193:0:14341:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ba2a817 reply state 000000007ea94d3d transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eb006 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666376.022222:0:14341:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788666376.022360:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+28:14517:x1875552173681792:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 2125us (2359us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1788666376.022368:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 46 00010000:00010000:3.0:1788666376.024764:0:3261:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eb006 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.024781:0:3261:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eb006 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.024789:0:3261:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eb006 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.024808:0:3261:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4c00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666376.024814:0:3261:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eb006 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.024821:0:3261:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eb006 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.024837:0:3261:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab2a402ca00) 00010000:00010000:3.0:1788666376.024839:0:3261:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788666376.024844:0:3261:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eb006 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.024850:0:3261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4c00/0x96bbe788361eb006 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666376.029005:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666376.029099:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173681920 00000100:00100000:3.0:1788666376.029109:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173681920 00000100:00100000:3.0:1788666376.029171:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:3.0:1788666376.029178:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a312b542-833a-4024-a333-5685ada48983+27:14517:x1875552173681920:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788666376.029203:0:14342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788666376.029224:0:14342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361eb00d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42ddf expref: -99 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.029299:0:14342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361eb00d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ddf expref: 28 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.029315:0:14342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361eb00d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ddf expref: 28 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.029405:0:14342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab2a402ca00) 00010000:00010000:3.0:1788666376.029409:0:14342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788666376.029413:0:14342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab2b47e9800, rc 0) 00000100:00100000:3.0:1788666376.029478:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a312b542-833a-4024-a333-5685ada48983+28:14517:x1875552173681920:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 300us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666376.029485:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 47 00000100:00100000:0.0:1788666376.031663:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666376.031842:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173682048 00000100:00100000:3.0:1788666376.031849:0:15026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173682048 00000100:00100000:3.0:1788666376.031935:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00100000:3.0:1788666376.031945:0:15026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a312b542-833a-4024-a333-5685ada48983+5:2362:x1875552173682048:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788666376.032305:0:15026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a312b542-833a-4024-a333-5685ada48983+6:2362:x1875552173682048:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 361us (655us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788666376.032314:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 12 00000100:00080000:0.0:1788666376.033083:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788666376.034325:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666376.034404:0:14344:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173682304 00000100:00100000:3.0:1788666376.034413:0:14344:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173682304 00000100:00100000:3.0:1788666376.034461:0:14344:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:3.0:1788666376.034468:0:14344:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a312b542-833a-4024-a333-5685ada48983+28:14517:x1875552173682304:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788666376.034985:0:14344:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a312b542-833a-4024-a333-5685ada48983+29:14517:x1875552173682304:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 516us (665us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1788666376.034992:0:14344:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 9 00000100:00100000:1.0:1788666376.036880:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666376.036991:0:15046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173682560 00000100:00100000:0.0:1788666376.037000:0:15046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173682560 00000100:00100000:0.0:1788666376.037067:0:15046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:0.0:1788666376.037077:0:15046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a312b542-833a-4024-a333-5685ada48983+29:14517:x1875552173682560:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788666376.037323:0:15046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a312b542-833a-4024-a333-5685ada48983+29:14517:x1875552173682560:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 246us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666376.037331:0:15046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 48 00000100:00100000:0.0:1788666376.040502:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666376.040953:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173682688 00000100:00100000:2.0:1788666376.040965:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173682688 00000100:00100000:2.0:1788666376.041064:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:2.0:1788666376.041075:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a312b542-833a-4024-a333-5685ada48983+29:14517:x1875552173682688:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788666376.041097:0:14343:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666376.041118:0:14343:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5000/0x96bbe788361eb014 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42de6 expref: -99 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.041198:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eb01b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.041213:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eb01b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.041226:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eb01b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788666376.041271:0:14343:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788666376.041291:0:14343:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eb01b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.041342:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5000/0x96bbe788361eb014 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42de6 expref: 31 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.041360:0:14343:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eb01b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42de6 expref: 30 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.041369:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab2a402ca00) 00010000:00010000:2.0:1788666376.041372:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788666376.041387:0:14343:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd5400, rc 0) 00000100:00100000:2.0:1788666376.041503:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a312b542-833a-4024-a333-5685ada48983+30:14517:x1875552173682688:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 429us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666376.041520:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 49 00000100:00100000:0.0:1788666376.046377:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666376.046463:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173682816 00000100:00100000:2.0:1788666376.046474:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173682816 00000100:00100000:2.0:1788666376.046541:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:2.0:1788666376.046551:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a312b542-833a-4024-a333-5685ada48983+6:2363:x1875552173682816:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788666376.046570:0:15024:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788666376.046624:0:15024:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdb87df0/0x96bbe788361eb022 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x99befbfc7d42ded expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788666376.046663:0:15024:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9ce208, blocks: 0x1 00010000:00010000:2.0:1788666376.046689:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=482s v=(0 0) 00010000:00010000:2.0:1788666376.046694:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666376.046705:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdb87df0/0x96bbe788361eb022 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ded expref: 7 pid: 15024 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.046745:0:15024:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bdb87df0/0x96bbe788361eb022 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ded expref: 7 pid: 15024 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.046759:0:15024:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8ab283fd4400, rc 0) 00000100:00100000:2.0:1788666376.046815:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a312b542-833a-4024-a333-5685ada48983+7:2363:x1875552173682816:12345-192.168.201.25@tcp:101:lhsmtool_posix.0 Request processed in 264us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666376.046822:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:1.0:1788666376.050052:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666376.050135:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173683072 00000100:00100000:2.0:1788666376.050144:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173683072 00000100:00100000:2.0:1788666376.050217:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:2.0:1788666376.050227:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+30:14517:x1875552173683072:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788666376.050359:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+30:14517:x1875552173683072:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 133us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666376.050367:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 50 00000100:00100000:1.0:1788666376.053788:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666376.053877:0:14342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173683200 00000100:00100000:3.0:1788666376.053887:0:14342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173683200 00000100:00100000:3.0:1788666376.053947:0:14342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00100000:3.0:1788666376.053957:0:14342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a312b542-833a-4024-a333-5685ada48983+30:14517:x1875552173683200:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788666376.101114:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:0.0:1788666376.101273:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934607 is committed 00000001:00080000:0.0:1788666376.101282:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:0.0:1788666376.101287:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:0.0:1788666376.101291:0:5830:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788666376.101328:0:5830:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:1.0:1788666376.101565:0:3278:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788666376.101629:0:3278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186249984:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788666376.101713:0:3278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666376.102465:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186249984 00000100:00100000:0.0:1788666376.102476:0:15026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186249984 00000100:00100000:0.0:1788666376.102724:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788666376.102734:0:15026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3278:x1875552186249984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788666376.102916:0:15026:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788666376.102920:0:15026:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788666376.102922:0:15026:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788666376.102924:0:15026:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788666376 -> 1788666376 00002000:00010000:0.0:1788666376.102926:0:15026:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788666376.102988:0:15026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3278:x1875552186249984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 256us (1274us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788666376.102995:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788666376.103335:0:14342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a312b542-833a-4024-a333-5685ada48983+14:14517:x1875552173683200:12345-192.168.201.25@tcp:44:lhsmtool_posix.0 Request processed in 49375us (49553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666376.103344:0:14342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 51 00000100:00080000:1.0:1788666376.106096:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788666376.106217:0:3278:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8ab2c1aba680/2, rc 0, transno 8589934595 00000100:00100000:1.0:1788666376.106231:0:3278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3278:1875552186249984:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788666376.107091:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666376.107257:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173683328 00000100:00100000:0.0:1788666376.107274:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173683328 00000100:00100000:0.0:1788666376.107366:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:0.0:1788666376.107376:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a312b542-833a-4024-a333-5685ada48983+7:2362:x1875552173683328:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788666376.107487:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae279f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a312b542-833a-4024-a333-5685ada48983+7:2362:x1875552173683328:12345-192.168.201.25@tcp:16:lhsmtool_posix.0 Request processed in 113us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666376.107496:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:1.0:1788666376.110473:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666376.110576:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173683584 00000100:00100000:2.0:1788666376.110626:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173683584 00000100:00100000:2.0:1788666376.110693:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:2.0:1788666376.110703:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+14:14517:x1875552173683584:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788666376.110756:0:14341:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666376.110784:0:14341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eb01b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42de6 expref: 14 pid: 14343 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.110802:0:14341:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab2a402ca00) 00010000:00010000:2.0:1788666376.110807:0:14341:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788666376.110854:0:14341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4800/0x96bbe788361eb029 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.110868:0:14341:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4800/0x96bbe788361eb029 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.110878:0:14341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4800/0x96bbe788361eb029 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788666376.111071:0:14341:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a0525cf reply state 0000000047555421 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4800/0x96bbe788361eb029 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666376.111080:0:14341:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788666376.111172:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+15:14517:x1875552173683584:12345-192.168.201.25@tcp:36:lhsmtool_posix.0 Request processed in 469us (706us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788666376.111180:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 52 00000100:00100000:1.0:1788666376.113973:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00010000:00010000:3.0:1788666376.114052:0:3262:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4800/0x96bbe788361eb029 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.114065:0:3262:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4800/0x96bbe788361eb029 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.114072:0:3262:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4800/0x96bbe788361eb029 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.114079:0:3262:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4800 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666376.114085:0:3262:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4800/0x96bbe788361eb029 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.114092:0:3262:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4800/0x96bbe788361eb029 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.114108:0:3262:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab2a402ca00) 00010000:00010000:3.0:1788666376.114112:0:3262:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666376.114116:0:3262:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4800/0x96bbe788361eb029 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.114123:0:3262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4800/0x96bbe788361eb029 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14341 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666376.114355:0:15023:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173683712 00000100:00100000:0.0:1788666376.114365:0:15023:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173683712 00000100:00100000:2.0:1788666376.114524:0:15023:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:2.0:1788666376.114534:0:15023:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a312b542-833a-4024-a333-5685ada48983+7:2364:x1875552173683712:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788666376.114769:0:15023:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788666376.114773:0:15023:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788666375 00002000:00010000:2.0:1788666376.114775:0:15023:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788666375 00002000:00010000:2.0:1788666376.114777:0:15023:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788666376 -> 1788666375 00002000:00010000:2.0:1788666376.114779:0:15023:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788666376.114832:0:15023:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a312b542-833a-4024-a333-5685ada48983+8:2364:x1875552173683712:12345-192.168.201.25@tcp:2:lhsmtool_posix.0 Request processed in 299us (866us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788666376.114840:0:15023:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:1.0:1788666376.119398:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666376.119813:0:15024:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173683840 00000100:00100000:2.0:1788666376.119824:0:15024:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173683840 00000100:00100000:2.0:1788666376.119880:0:15024:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:2.0:1788666376.119903:0:15024:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a312b542-833a-4024-a333-5685ada48983+8:2363:x1875552173683840:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788666376.119951:0:15024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000014787e29/0x96bbe788361eb030 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.119967:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666376.119971:0:15024:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666376.119977:0:15024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014787e29/0x96bbe788361eb030 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.119991:0:15024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014787e29/0x96bbe788361eb030 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.120020:0:15024:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000014787e29/0x96bbe788361eb030 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.120028:0:15024:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014787e29/0x96bbe788361eb030 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.120039:0:15024:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014787e29/0x96bbe788361eb030 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.120047:0:15024:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd4200 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666376.120051:0:15024:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014787e29/0x96bbe788361eb030 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.120061:0:15024:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014787e29/0x96bbe788361eb030 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.120083:0:15024:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014787e29/0x96bbe788361eb030 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.120091:0:15024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014787e29/0x96bbe788361eb030 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666376.120173:0:15024:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a312b542-833a-4024-a333-5685ada48983+8:2363:x1875552173683840:12345-192.168.201.25@tcp:1:lhsmtool_posix.0 Request processed in 272us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666376.120181:0:15024:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:1.0:1788666376.123918:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666376.124002:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173684096 00000100:00100000:3.0:1788666376.124012:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173684096 00000100:00100000:3.0:1788666376.124063:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 53 00000100:00100000:3.0:1788666376.124087:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a312b542-833a-4024-a333-5685ada48983+14:14517:x1875552173684096:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788666376.124185:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8000/0x96bbe788361eb037 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.124203:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8000/0x96bbe788361eb037 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.124215:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8000/0x96bbe788361eb037 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.124464:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eb03e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.124475:0:14343:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361eb00d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ddf expref: 15 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.124484:0:14343:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eb03e lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.124534:0:14343:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361eb00d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ddf expref: 15 pid: 14342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.124548:0:14343:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361eb00d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ddf expref: 15 pid: 14342 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666376.124563:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae27a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14343:1875552186250112:192.168.201.25@tcp:104: 00000100:00100000:3.0:1788666376.124959:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29a86f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788666376.130348:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666376.130450:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae27a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14343:1875552186250112:192.168.201.25@tcp:104: 00010000:00010000:3.0:1788666376.130475:0:14343:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eb03e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666376.130621:0:14327:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173684224 00000100:00100000:0.0:1788666376.130628:0:14327:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173684224 00010000:00010000:0.0:1788666376.130793:0:14327:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361eb00d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ddf expref: 16 pid: 14342 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666376.130830:0:14327:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 13 00000100:00100000:0.0:1788666376.130840:0:14327:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a312b542-833a-4024-a333-5685ada48983+16:2363:x1875552173684224:12345-192.168.201.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788666376.130856:0:14327:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788666376.130862:0:14327:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361eb00d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ddf expref: 16 pid: 14342 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.130880:0:14327:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361eb00d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ddf expref: 16 pid: 14342 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.130900:0:14327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9800/0x96bbe788361eb00d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ddf expref: 16 pid: 14342 timeout: 582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.130915:0:14327:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab2a402ca00) 00010000:00010000:0.0:1788666376.130929:0:14327:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eb03e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.130940:0:14327:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eb03e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.130947:0:14327:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eb03e lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.130973:0:14327:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788666376.131035:0:14327:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a312b542-833a-4024-a333-5685ada48983+15:2363:x1875552173684224:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 196us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666376.131043:0:14327:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 13 00010000:00010000:3.0:1788666376.131133:0:14343:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eb03e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.131141:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eb03e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788666376.131326:0:14343:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1788666376.131463:0:14343:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1788666376.131500:0:14343:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1788666376.131634:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae27a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14343:1875552186250240:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788666376.131902:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788666376.131942:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab284e7d840 going to sleep for 11 seconds 00000100:00100000:3.0:1788666376.131974:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186250240 00000100:00100000:3.0:1788666376.131979:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186250240 00000100:00100000:3.0:1788666376.132007:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788666376.132014:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14343:x1875552186250240:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788666376.132079:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae279180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14343:x1875552186250240:12345-0@lo:1000:mdt00_002.0 Request processed in 65us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666376.132085:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788666376.132122:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae27a300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14343:1875552186250240:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788666376.134972:0:14343:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788666376.135084:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2c1ab8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14343:1875552186250368:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788666376.135915:0:14343:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666376.135989:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab29053ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788666376.136960:0:14346:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186250368 00000100:00100000:3.0:1788666376.136971:0:14346:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186250368 00000100:00100000:2.0:1788666376.137165:0:14346:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788666376.137175:0:14346:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14343:x1875552186250368:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788666376.137460:0:14346:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14343:x1875552186250368:12345-0@lo:1000:mdt00_002.0 Request processed in 285us (2309us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788666376.137468:0:14346:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788666376.137557:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2c1ab8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14343:1875552186250368:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788666376.137647:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eb03e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.137664:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eb03e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.137671:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eb03e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.137691:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e9e00 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666376.137696:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eb03e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.137703:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eb03e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.137718:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab2a402ca00) 00010000:00010000:0.0:1788666376.137721:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788666376.137726:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eb03e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.137732:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9e00/0x96bbe788361eb03e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.137762:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf9d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.137768:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf9d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.137773:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf9d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.137777:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd5200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:0.0:1788666376.137780:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf9d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.137785:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf9d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.137803:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab2a402c100) 00010000:00010000:0.0:1788666376.137805:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788666376.137811:0:14343:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eafa4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42dc3 expref: 18 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.137822:0:14343:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eafa4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42dc3 expref: 18 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.137830:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eafa4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42dc3 expref: 18 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.137887:0:14343:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd4000/0x96bbe788361eafa4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42dc3 expref: 18 pid: 14341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788666376.137900:0:14343:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14343:1875552186250496:192.168.201.25@tcp:105: 00000100:00100000:0.0:1788666376.137967:0:14343:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2aea25000 going to sleep for 11 seconds 00000100:00100000:3.0:1788666376.142319:0:14343:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14343:1875552186250496:192.168.201.25@tcp:105: 00010000:00010000:3.0:1788666376.142347:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf9d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.142358:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5200/0x96bbe788361eaf9d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.142416:0:14343:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361eb045 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.142431:0:14343:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361eb045 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.142444:0:14343:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361eb045 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.142455:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361eb045 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.142461:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361eb045 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.142468:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361eb045 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.142473:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e9200 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666376.142477:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361eb045 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.142484:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361eb045 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.142496:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab2a402c100) 00010000:00010000:3.0:1788666376.142499:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788666376.142502:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361eb045 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.142519:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e9200/0x96bbe788361eb045 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.142538:0:14343:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8000/0x96bbe788361eb037 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.142543:0:14343:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8000/0x96bbe788361eb037 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.142548:0:14343:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8000/0x96bbe788361eb037 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.142552:0:14343:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e8000 already unused, calling callback (ffffffffc1f8b4f0) 00010000:00010000:3.0:1788666376.142555:0:14343:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8000/0x96bbe788361eb037 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.142560:0:14343:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8000/0x96bbe788361eb037 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.142569:0:14343:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8ab2a402c100) 00010000:00010000:3.0:1788666376.142571:0:14343:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788666376.142573:0:14343:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8000/0x96bbe788361eb037 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.142815:0:14343:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab2b47e8000/0x96bbe788361eb037 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14343 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666376.143043:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666376.143082:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173684352 00000100:00100000:1.0:1788666376.143089:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173684352 00000100:00100000:1.0:1788666376.143140:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:1.0:1788666376.143149:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b4813450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a312b542-833a-4024-a333-5685ada48983+19:14516:x1875552173684352:12345-192.168.201.25@tcp:49:dd.0 00000100:00100000:1.0:1788666376.143297:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b4813450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a312b542-833a-4024-a333-5685ada48983+19:14516:x1875552173684352:12345-192.168.201.25@tcp:49:dd.0 Request processed in 148us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666376.143304:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 10 00000100:00100000:3.0:1788666376.143419:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a312b542-833a-4024-a333-5685ada48983+18:14517:x1875552173684096:12345-192.168.201.25@tcp:57:lhsmtool_posix.0 Request processed in 19333us (19847us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788666376.143427:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 53 00000020:00080000:3.0:1788666376.143430:0:14343:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788666376.150013:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666376.150111:0:14345:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173684608 00000100:00100000:2.0:1788666376.150122:0:14345:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173684608 00000100:00100000:2.0:1788666376.150186:0:14345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 11 00000100:00100000:2.0:1788666376.150197:0:14345:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae27a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a312b542-833a-4024-a333-5685ada48983+18:14517:x1875552173684608:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788666376.153088:0:14345:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788666376.153292:0:14345:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788666376.153375:0:14345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eb04c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.154316:0:14345:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eb04c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.154330:0:14345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eb04c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.154339:0:14345:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eb04c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.154346:0:14345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eb04c lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.154353:0:14345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eb04c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.154834:0:14345:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788666376.154972:0:14345:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae27a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a312b542-833a-4024-a333-5685ada48983+20:14517:x1875552173684608:12345-192.168.201.25@tcp:35:lhsmtool_posix.0 Request processed in 4771us (4963us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788666376.154986:0:14345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 11 00000020:00080000:2.0:1788666376.154993:0:14345:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:0.0:1788666376.156907:0:14373:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788666376.156915:0:14373:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788666376.156947:0:14373:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788666376.156953:0:14373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788666376.161828:0:15960:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788666376.161843:0:15960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eb04c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666376.161881:0:15960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd5400 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:1.0:1788666376.161886:0:15960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eb04c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666376.161895:0:15960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eb04c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666376.161915:0:15960:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8ab2a402ca00) 00010000:00010000:1.0:1788666376.161918:0:15960:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788666376.161923:0:15960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eb04c lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666376.161930:0:15960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8ab283fd5400/0x96bbe788361eb04c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14345 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666376.161947:0:15960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666376.161950:0:15960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788666376.161952:0:15960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788666376.310188:0:3268:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666376.310638:0:15029:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173684736 00000100:00100000:1.0:1788666376.310718:0:15029:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173684736 00000100:00100000:1.0:1788666376.310844:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 0 00000100:00100000:1.0:1788666376.310855:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2ae279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a312b542-833a-4024-a333-5685ada48983+8:2363:x1875552173684736:12345-192.168.201.25@tcp:4:dd.0 00010000:00010000:1.0:1788666376.310894:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ba9ae9d/0x96bbe788361eb053 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666376.310929:0:15029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bdb87df0/0x96bbe788361eb022 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ded expref: 8 pid: 15024 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666376.310939:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788666376.310952:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666376.310957:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ba9ae9d/0x96bbe788361eb053 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666376.310998:0:15029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bdb87df0/0x96bbe788361eb022 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ded expref: 8 pid: 15024 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666376.311014:0:15029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bdb87df0/0x96bbe788361eb022 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ded expref: 8 pid: 15024 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666376.311029:0:15029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2aea1c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15029:1875552186250624:192.168.201.25@tcp:104: 00000100:00100000:1.0:1788666376.311120:0:15029:0:(client.c:2716:ptlrpc_set_wait()) set ffff8ab2bfb24b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788666376.314028:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666376.317793:0:15030:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788666376.317943:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666376.318017:0:15031:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788666376.318335:0:15030:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788666376.321438:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173684864 00000100:00100000:0.0:1788666376.321454:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173684864 00000100:00100000:2.0:1788666376.321887:0:3270:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666376.321918:0:14328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173685120 00000100:00100000:2.0:1788666376.321922:0:14328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173685120 00010000:00010000:2.0:1788666376.321951:0:14328:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bdb87df0/0x96bbe788361eb022 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ded expref: 10 pid: 15024 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666376.321981:0:14328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 14 00000100:00100000:2.0:1788666376.321996:0:14328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a312b542-833a-4024-a333-5685ada48983+10:2364:x1875552173685120:12345-192.168.201.25@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788666376.321999:0:16571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173684992 00000100:00100000:3.0:1788666376.322003:0:16571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173684992 00000100:00100000:3.0:1788666376.322027:0:16571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 1 00000100:00100000:3.0:1788666376.322034:0:16571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1ab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a312b542-833a-4024-a333-5685ada48983+11:2363:x1875552173684864:12345-192.168.201.25@tcp:4:dd.0 00010000:00010000:3.0:1788666376.322067:0:16571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb05a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.322085:0:16571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666376.322091:0:16571:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666376.322096:0:16571:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb05a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.322107:0:16571:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb05a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.322141:0:14328:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788666376.322164:0:14328:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bdb87df0/0x96bbe788361eb022 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ded expref: 11 pid: 15024 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.322176:0:14328:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bdb87df0/0x96bbe788361eb022 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ded expref: 11 pid: 15024 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666376.322179:0:15029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2aea1c700 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15029:1875552186250624:192.168.201.25@tcp:104: 00010000:00010000:2.0:1788666376.322197:0:14328:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdb87df0/0x96bbe788361eb022 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.25@tcp remote: 0x99befbfc7d42ded expref: 11 pid: 15024 timeout: 583 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.322198:0:15029:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002ba9ae9d/0x96bbe788361eb053 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.322210:0:14328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666376.322213:0:14328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666376.322219:0:14328:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002ba9ae9d/0x96bbe788361eb053 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.322228:0:14328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ba9ae9d/0x96bbe788361eb053 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.322236:0:14328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666376.322239:0:14328:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666376.322243:0:14328:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb05a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.322250:0:14328:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb05a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.322301:0:14328:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788666376.322350:0:14328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a312b542-833a-4024-a333-5685ada48983+10:2364:x1875552173685120:12345-192.168.201.25@tcp:103:ldlm_bl.0 Request processed in 354us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666376.322358:0:14328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 14 00010000:00010000:2.0:1788666376.322469:0:15029:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002ba9ae9d/0x96bbe788361eb053 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.322479:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ba9ae9d/0x96bbe788361eb053 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.322605:0:16571:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb05a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.322614:0:16571:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb05a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666376.326955:0:15031:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1788666376.332966:0:16572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 2 00000100:00100000:1.0:1788666376.332985:0:16572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1abad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a312b542-833a-4024-a333-5685ada48983+11:2363:x1875552173684992:12345-192.168.201.25@tcp:4:dd.0 00010000:00010000:1.0:1788666376.333034:0:16572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8a0c3ad/0x96bbe788361eb061 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666376.333056:0:16572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666376.333061:0:16572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666376.333069:0:16572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d8a0c3ad/0x96bbe788361eb061 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666376.333085:0:16572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d8a0c3ad/0x96bbe788361eb061 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788666376.418527:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1788666376.418547:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:2.0:1788666376.418558:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:2.0:1788666376.418639:0:15029:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:2.0:1788666376.418643:0:15029:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788666375 -> 1788666376 00002000:00010000:2.0:1788666376.418653:0:15029:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:2.0:1788666376.418669:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ba9ae9d/0x96bbe788361eb053 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.418681:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ba9ae9d/0x96bbe788361eb053 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.418690:0:15029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ba9ae9d/0x96bbe788361eb053 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.418697:0:15029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855200 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666376.418717:0:15029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ba9ae9d/0x96bbe788361eb053 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.418727:0:15029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ba9ae9d/0x96bbe788361eb053 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.418750:0:15029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ba9ae9d/0x96bbe788361eb053 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.418758:0:15029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ba9ae9d/0x96bbe788361eb053 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666376.418845:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2ae279500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a312b542-833a-4024-a333-5685ada48983+11:2363:x1875552173684736:12345-192.168.201.25@tcp:4:dd.0 Request processed in 107988us (108664us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788666376.418859:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 0 00010000:00010000:3.0:1788666376.419320:0:16571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb05a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.419342:0:16571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb05a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.419349:0:16571:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb05a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.419354:0:16571:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e8000 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666376.419357:0:16571:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb05a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.419364:0:16571:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb05a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.419375:0:16571:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb05a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.419383:0:16571:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb05a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666376.419441:0:16571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1ab8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a312b542-833a-4024-a333-5685ada48983+9:2363:x1875552173684864:12345-192.168.201.25@tcp:4:dd.0 Request processed in 97406us (105433us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788666376.419448:0:16571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 1 00002000:00010000:3.0:1788666376.449112:0:16572:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:3.0:1788666376.449135:0:16572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d8a0c3ad/0x96bbe788361eb061 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.449178:0:16572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d8a0c3ad/0x96bbe788361eb061 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.449187:0:16572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d8a0c3ad/0x96bbe788361eb061 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.449194:0:16572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298855800 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666376.449199:0:16572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8a0c3ad/0x96bbe788361eb061 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.449207:0:16572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d8a0c3ad/0x96bbe788361eb061 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.449360:0:16572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d8a0c3ad/0x96bbe788361eb061 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.449368:0:16572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d8a0c3ad/0x96bbe788361eb061 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666376.449512:0:16572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1abad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a312b542-833a-4024-a333-5685ada48983+7:2363:x1875552173684992:12345-192.168.201.25@tcp:4:dd.0 Request processed in 116528us (131568us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788666376.449524:0:16572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 2 00000001:00080000:2.0:1788666376.449751:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00000100:00100000:2.0:1788666376.458485:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666376.458546:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:2.0:1788666376.458655:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:3.0:1788666376.458793:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173685248 00000100:00100000:3.0:1788666376.458802:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173685248 00000100:00100000:3.0:1788666376.458888:0:15030:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173685376 00000100:00100000:3.0:1788666376.458891:0:15030:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173685376 00000100:00100000:2.0:1788666376.458997:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:0.0:1788666376.459010:0:15031:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173685504 00000100:00100000:0.0:1788666376.459014:0:15031:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173685504 00000100:00100000:0.0:1788666376.459040:0:15031:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 3 00000100:00100000:0.0:1788666376.459049:0:15031:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1ab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a312b542-833a-4024-a333-5685ada48983+7:2364:x1875552173685248:12345-192.168.201.25@tcp:4:dd.0 00002000:00010000:0.0:1788666376.459123:0:15031:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9ce208, atime: 0x6a9ce207, ctime: 0x0, blocks: 0x1807 00010000:00010000:0.0:1788666376.459134:0:15031:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8c6857d/0x96bbe788361eb068 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.459150:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=483s v=(0 0) 00010000:00010000:0.0:1788666376.459154:0:15031:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788666376.459159:0:15031:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8c6857d/0x96bbe788361eb068 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788666376.459170:0:15031:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8c6857d/0x96bbe788361eb068 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666376.459535:0:15029:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 4 00000100:00100000:1.0:1788666376.459543:0:15029:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a312b542-833a-4024-a333-5685ada48983+8:2364:x1875552173685376:12345-192.168.201.25@tcp:4:dd.0 00010000:00010000:1.0:1788666376.459557:0:15029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001edbb48b/0x96bbe788361eb06f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666376.459565:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666376.459567:0:15029:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788666376.459570:0:15029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001edbb48b/0x96bbe788361eb06f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666376.459577:0:15029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001edbb48b/0x96bbe788361eb06f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666376.460395:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:3.0:1788666376.460408:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c1abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a312b542-833a-4024-a333-5685ada48983+8:2364:x1875552173685504:12345-192.168.201.25@tcp:4:dd.0 00010000:00010000:3.0:1788666376.460431:0:15030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb076 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.460441:0:15030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666376.460444:0:15030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666376.460449:0:15030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb076 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.460458:0:15030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb076 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666376.460732:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666376.460794:0:16572:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1788666376.460803:0:16572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1788666376.461186:0:16572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173685632 00000100:00100000:1.0:1788666376.461195:0:16572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173685632 00000100:00100000:1.0:1788666376.461241:0:16572:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1788666376.461248:0:16572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173685760 00000100:00100000:1.0:1788666376.461260:0:16572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173685760 00000100:00100000:2.0:1788666376.463454:0:16574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 6 00000100:00100000:2.0:1788666376.463469:0:16574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2bfa77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a312b542-833a-4024-a333-5685ada48983+11:2364:x1875552173685632:12345-192.168.201.25@tcp:4:dd.0 00010000:00010000:2.0:1788666376.463510:0:16574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003af76f07/0x96bbe788361eb07d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.463526:0:16574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666376.463535:0:16574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788666376.463540:0:16574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003af76f07/0x96bbe788361eb07d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.463553:0:16574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003af76f07/0x96bbe788361eb07d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788666376.524368:0:15030:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7340032 00002000:00010000:3.0:1788666376.524379:0:15030:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1788666376.524395:0:15030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb076 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.524408:0:15030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb076 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.524417:0:15030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb076 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.524423:0:15030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e8000 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666376.524429:0:15030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb076 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.524456:0:15030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb076 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.524476:0:15030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb076 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.524485:0:15030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063dcc0b2/0x96bbe788361eb076 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666376.524629:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1abbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a312b542-833a-4024-a333-5685ada48983+20:2364:x1875552173685504:12345-192.168.201.25@tcp:4:dd.0 Request processed in 64176us (65924us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788666376.524639:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 5 00000100:00100000:3.0:1788666376.524674:0:15030:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 7 00000100:00100000:3.0:1788666376.524686:0:15030:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2905ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a312b542-833a-4024-a333-5685ada48983+19:2364:x1875552173685760:12345-192.168.201.25@tcp:4:dd.0 00010000:00010000:3.0:1788666376.524717:0:15030:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007756e957/0x96bbe788361eb084 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.524730:0:15030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666376.524735:0:15030:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788666376.524741:0:15030:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007756e957/0x96bbe788361eb084 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.524753:0:15030:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007756e957/0x96bbe788361eb084 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788666376.525122:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:2.0:1788666376.580564:0:15030:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1788666376.580575:0:15030:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788666376 00002000:00010000:2.0:1788666376.580614:0:15030:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 16391 00010000:00010000:2.0:1788666376.580633:0:15030:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007756e957/0x96bbe788361eb084 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.580648:0:15030:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007756e957/0x96bbe788361eb084 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.580658:0:15030:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007756e957/0x96bbe788361eb084 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.580666:0:15030:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2b47e9200 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:2.0:1788666376.580671:0:15030:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007756e957/0x96bbe788361eb084 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.580681:0:15030:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007756e957/0x96bbe788361eb084 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.580703:0:15030:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007756e957/0x96bbe788361eb084 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788666376.580722:0:15030:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007756e957/0x96bbe788361eb084 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15030 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788666376.580825:0:15030:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2905ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a312b542-833a-4024-a333-5685ada48983+19:2364:x1875552173685760:12345-192.168.201.25@tcp:4:dd.0 Request processed in 56138us (120089us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788666376.580835:0:15030:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 7 00000001:00080000:2.0:1788666376.580878:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00000001:00080000:2.0:1788666376.580894:0:6678:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:3.0:1788666376.581743:0:15029:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001edbb48b/0x96bbe788361eb06f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.581757:0:15029:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001edbb48b/0x96bbe788361eb06f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.581764:0:15029:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001edbb48b/0x96bbe788361eb06f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.581770:0:15029:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab298854200 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666376.581774:0:15029:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001edbb48b/0x96bbe788361eb06f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.581781:0:15029:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001edbb48b/0x96bbe788361eb06f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.581795:0:15029:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001edbb48b/0x96bbe788361eb06f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.581802:0:15029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001edbb48b/0x96bbe788361eb06f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666376.581862:0:15029:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a312b542-833a-4024-a333-5685ada48983+9:2364:x1875552173685376:12345-192.168.201.25@tcp:4:dd.0 Request processed in 122317us (123311us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788666376.581870:0:15029:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 4 00010000:00010000:3.0:1788666376.582800:0:15031:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8c6857d/0x96bbe788361eb068 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.582817:0:15031:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8c6857d/0x96bbe788361eb068 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.582825:0:15031:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8c6857d/0x96bbe788361eb068 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.582832:0:15031:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab2bfa7f200 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:3.0:1788666376.582837:0:15031:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8c6857d/0x96bbe788361eb068 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.582844:0:15031:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8c6857d/0x96bbe788361eb068 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.582859:0:15031:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8c6857d/0x96bbe788361eb068 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788666376.582867:0:15031:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8c6857d/0x96bbe788361eb068 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15031 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788666376.582924:0:15031:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c1ab9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:a312b542-833a-4024-a333-5685ada48983+7:2364:x1875552173685248:12345-192.168.201.25@tcp:4:dd.0 Request processed in 123873us (124444us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1788666376.582933:0:15031:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 3 00010000:00010000:1.0:1788666376.583828:0:16574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003af76f07/0x96bbe788361eb07d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666376.583843:0:16574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003af76f07/0x96bbe788361eb07d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666376.583850:0:16574:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003af76f07/0x96bbe788361eb07d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666376.583867:0:16574:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8ab283fd5000 already unused, calling callback (ffffffffc15647b0) 00010000:00010000:1.0:1788666376.583871:0:16574:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003af76f07/0x96bbe788361eb07d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666376.583879:0:16574:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003af76f07/0x96bbe788361eb07d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666376.583893:0:16574:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003af76f07/0x96bbe788361eb07d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788666376.583901:0:16574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003af76f07/0x96bbe788361eb07d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788666376.583969:0:16574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2bfa77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:a312b542-833a-4024-a333-5685ada48983+5:2364:x1875552173685632:12345-192.168.201.25@tcp:4:dd.0 Request processed in 120501us (124967us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1788666376.583977:0:16574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 6 00010000:00010000:3.0:1788666376.587702:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788666377.610819:0:14329:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666377.731813:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666377.731851:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666377.731885:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666377.731912:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666377.731932:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666377.731955:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666377.731979:0:3269:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.25@tcp (source: 12345-192.168.201.25@tcp) 00000100:00100000:1.0:1788666377.732002:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173686400 00000100:00100000:1.0:1788666377.732012:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173686400 00000100:00100000:1.0:1788666377.732079:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173686016 00000100:00100000:1.0:1788666377.732083:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173686016 00000100:00100000:2.0:1788666377.732104:0:14335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173685888 00000100:00100000:1.0:1788666377.732105:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 30 00000100:00100000:2.0:1788666377.732108:0:14335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173685888 00000100:00100000:1.0:1788666377.732114:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b480d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d4f8905-33ad-4a53-acca-61c229032b2c+6:2364:x1875552173686400:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666377.732146:0:14335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 122 00000100:00100000:2.0:1788666377.732153:0:14335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c10ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+13:2364:x1875552173685888:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666377.732207:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173686144 00000100:00100000:3.0:1788666377.732211:0:15026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173686144 00000100:00100000:3.0:1788666377.732243:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173686656 00000100:00100000:3.0:1788666377.732246:0:15026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173686656 00000100:00100000:3.0:1788666377.732260:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173686272 00000100:00100000:3.0:1788666377.732262:0:15026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173686272 00000100:00100000:3.0:1788666377.732275:0:15026:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552173686528 00000100:00100000:3.0:1788666377.732277:0:15026:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552173686528 00000100:00100000:3.0:1788666377.732293:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:3.0:1788666377.732300:0:15026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2aea1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a312b542-833a-4024-a333-5685ada48983+5:2364:x1875552173686144:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:1.0:1788666377.732358:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b480d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6d4f8905-33ad-4a53-acca-61c229032b2c+6:2364:x1875552173686400:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 244us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666377.732368:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 30 00000100:00100000:1.0:1788666377.732387:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 31 00000100:00100000:1.0:1788666377.732393:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+20:2364:x1875552173686016:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:2.0:1788666377.736979:0:14335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c10ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6a1c8cdf-dd2d-44f3-9222-01b90bbce586+13:2364:x1875552173685888:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 4813us (5164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666377.737003:0:15026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2aea1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a312b542-833a-4024-a333-5685ada48983+5:2364:x1875552173686144:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 4702us (5149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666377.737019:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 15 00000100:00100000:3.0:1788666377.737061:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:3.0:1788666377.737078:0:15026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2b456d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d4f8905-33ad-4a53-acca-61c229032b2c+5:2364:x1875552173686656:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666377.737130:0:15026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2b456d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d4f8905-33ad-4a53-acca-61c229032b2c+5:2364:x1875552173686656:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 60us (5218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666377.737137:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 16 00000100:00100000:3.0:1788666377.737149:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:3.0:1788666377.737156:0:15026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a312b542-833a-4024-a333-5685ada48983+5:2364:x1875552173686272:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666377.737179:0:15026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290505c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a312b542-833a-4024-a333-5685ada48983+5:2364:x1875552173686272:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 23us (5224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666377.737185:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 17 00000100:00100000:3.0:1788666377.737196:0:15026:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:3.0:1788666377.737204:0:15026:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d4f8905-33ad-4a53-acca-61c229032b2c+5:2364:x1875552173686528:12345-192.168.201.25@tcp:400:kworker.0 00000100:00100000:3.0:1788666377.737227:0:15026:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290504000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6d4f8905-33ad-4a53-acca-61c229032b2c+5:2364:x1875552173686528:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 25us (5248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666377.737257:0:15026:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 18 00000100:00100000:2.0:1788666377.737780:0:14335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 122 00000100:00080000:3.0:1788666377.737797:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788666377.737802:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788666377.737805:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788666377.738019:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290505500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a312b542-833a-4024-a333-5685ada48983+20:2364:x1875552173686016:12345-192.168.201.25@tcp:400:kworker.0 Request processed in 5623us (6083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788666377.738029:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.25@tcp, seq: 31 00000001:02000400:2.0:1788666378.077752:0:16611:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1788666378.634823:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788666378.634849:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2989fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186250752:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788666378.634947:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666378.635311:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186250752 00000100:00100000:2.0:1788666378.635319:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186250752 00000100:00100000:1.0:1788666378.635335:0:3276:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788666378.635345:0:3276:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab290507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186250880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788666378.635374:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788666378.635377:0:3276:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788666378.635383:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186250752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788666378.635421:0:15028:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788666378.635488:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3277:x1875552186250752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666378.635496:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788666378.635529:0:15028:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186250880 00000100:00100000:2.0:1788666378.635533:0:15028:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186250880 00000100:00100000:2.0:1788666378.635548:0:15028:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788666378.635553:0:15028:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186250880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788666378.635574:0:15028:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1788666378.635699:0:15028:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290505f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3276:x1875552186250880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 145us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788666378.635706:0:15028:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788666378.635741:0:3276:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1788666378.635747:0:3276:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8ab2c1aba680, transno 8589934595 00000004:00080000:2.0:1788666378.635759:0:3276:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1788666378.635789:0:3276:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab290507480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3276:1875552186250880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788666378.636180:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2989fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3277:1875552186250752:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788666378.636888:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788666378.636895:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788666378.637106:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186251392:0@lo:400:kworker.0 00000100:00100000:0.0:1788666378.637158:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666378.637196:0:3275:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788666378.637201:0:3275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae27a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3275:1875552186251008:0@lo:400:kworker.0 00000100:00100000:0.0:1788666378.637237:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666378.637272:0:14334:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186251008 00000100:00100000:0.0:1788666378.637279:0:14334:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186251008 00000100:00100000:0.0:1788666378.637313:0:14334:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788666378.637321:0:14334:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2c10ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:3275:x1875552186251008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666378.637366:0:14334:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2c10ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d6055fb2-45b5-486f-b848-f99f52ec1d9c+19:3275:x1875552186251008:12345-0@lo:400:kworker.0 Request processed in 46us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666378.637386:0:14334:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788666378.637424:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae27a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d6055fb2-45b5-486f-b848-f99f52ec1d9c:3275:1875552186251008:0@lo:400:kworker.0 00000100:00100000:3.0:1788666378.637757:0:14343:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186251392 00000100:00100000:3.0:1788666378.637763:0:14343:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186251392 00000100:00100000:3.0:1788666378.637811:0:14343:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788666378.637819:0:14343:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab2989fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186251392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788666378.637860:0:14343:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab2989fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3275:x1875552186251392:12345-0@lo:400:kworker.0 Request processed in 44us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788666378.637866:0:14343:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788666378.638060:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666378.638085:0:3275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae725880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3275:1875552186251392:0@lo:400:kworker.0 00010000:00010000:1.0:1788666378.638149:0:15960:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788666378.638163:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186251136:0@lo:400:kworker.0 00000100:00100000:1.0:1788666378.638195:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788666378.638236:0:3277:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788666378.638243:0:3277:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8ab2ae724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186251264:0@lo:400:kworker.0 00000100:00100000:0.0:1788666378.638252:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186251136 00000100:00100000:0.0:1788666378.638256:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186251136 00000100:00100000:1.0:1788666378.638264:0:3277:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788666378.642917:0:14341:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875552186251264 00000100:00100000:0.0:1788666378.642933:0:14341:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875552186251264 00000100:00100000:0.0:1788666378.642991:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788666378.643000:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186251136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666378.643092:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290506680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3277:x1875552186251136:12345-0@lo:400:kworker.0 Request processed in 93us (4896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666378.643099:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788666378.643116:0:14341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788666378.643121:0:14341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8ab290506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186251264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788666378.643146:0:14341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8ab290506300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3277:x1875552186251264:12345-0@lo:400:kworker.0 Request processed in 25us (4881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788666378.643151:0:14341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788666378.643170:0:14336:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788666378.643226:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae724380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3277:1875552186251264:0@lo:400:kworker.0 00000100:00100000:0.0:1788666378.643239:0:3277:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8ab2ae726a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3277:1875552186251136:0@lo:400:kworker.0 00000040:00080000:0.0:1788666379.213925:0:14373:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788666379.213934:0:14373:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788666379.213968:0:14373:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788666379.213974:0:14373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788666379.660074:0:14330:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29897 lines, 29897 kept, 0 dropped, 0 bad.